00000100:00100000:2.0F:1777580309.203256:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.203372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.203483:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946564352 00000100:00100000:2.0:1777580309.203497:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946564352 00000100:00100000:2.0:1777580309.203550:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830050450823 time 7830105646737 state 0x0 ref 1 00000100:00100000:2.0:1777580309.203568:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830105746737 time 7830105646737 state 0x1 ref 1 00000100:00100000:2.0:1777580309.203598:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830105746737 time 7830152459991 state 0x0 ref 1 00000100:00100000:2.0:1777580309.203611:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:282893:x1863919946564352:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.203647:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.203676:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e495d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90df98 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204051:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204072:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204087:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204107:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e495e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204115:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e495e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204122:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e495e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580309.204751:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1597:0x0], index 1: 0 00010000:00010000:2.0:1777580309.204950:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e495ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204962:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e495ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.204972:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e495ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205012:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205019:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205026:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205031:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.205035:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205041:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205051:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.205053:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.205057:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205076:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e495dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.205089:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e20836e9 reply state 000000000c3346ae transno 8589950511 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e495e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.205099:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580309.205160:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e495d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df98 expref: 144 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205176:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e495ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df98 expref: 143 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.205184:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa02498977c00) 00010000:00010000:2.0:1777580309.205186:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580309.205189:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f400, rc 0) 00000100:00100000:2.0:1777580309.205232:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:282893:x1863919946564352:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1624us (1860us total) trans 8589950511 rc 0/0 00000100:00100000:2.0:1777580309.205242:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19212 00000100:00100000:2.0:1777580309.205250:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830105746737 time 7830152459991 state 0x2 ref 0 00010000:00010000:2.0:1777580309.216551:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216572:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216581:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216600:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.216606:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216615:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216636:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02483f8e600) 00010000:00010000:2.0:1777580309.216639:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.216644:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.216650:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e495b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.222272:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946564608 00000100:00100000:2.0:1777580309.222287:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946564608 00000100:00100000:2.0:1777580309.222337:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830105746737 time 7830152459991 state 0x0 ref 1 00000100:00100000:2.0:1777580309.222353:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830152559991 time 7830152459991 state 0x1 ref 1 00000100:00100000:2.0:1777580309.222376:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946564864 00000100:00100000:2.0:1777580309.222379:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946564864 00000100:00100000:2.0:1777580309.222394:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830152559991 time 7830152459991 state 0x1 ref 2 00000100:00100000:2.0:1777580309.222424:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830171386704 time 7830171286704 state 0x1 ref 2 00000100:00100000:2.0:1777580309.222438:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:282893:x1863919946564608:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580309.222524:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580309.222568:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e495ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df98 expref: 144 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.222590:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa02498977c00) 00010000:00010000:2.0:1777580309.222604:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580309.222820:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e495f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.222836:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e495f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.222848:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e495f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.223063:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000c52a0e5 reply state 00000000acc927b0 transno 8589950512 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e495f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.223074:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580309.223216:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:282893:x1863919946564608:12345-192.168.202.9@tcp:36:touch.500 Request processed in 779us (1146us total) trans 8589950512 rc 0/0 00000100:00100000:2.0:1777580309.223226:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19213 00000100:00100000:2.0:1777580309.223255:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830171386704 time 7830172118217 state 0x0 ref 1 00000100:00100000:2.0:1777580309.223268:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:282895:x1863919946564864:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.223280:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.223293:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e495ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90df9f expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223414:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223436:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223445:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223460:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223468:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.223475:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580309.224489:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15bc:0x0], index 0: 0 00010000:00010000:2.0:1777580309.225990:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49614 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226017:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49614 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226030:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49614 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226085:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226092:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226099:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226118:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.226123:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226131:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226524:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.226527:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.226533:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226540:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49606 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.226557:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000896c07d1 reply state 0000000065304b60 transno 8589950513 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.226568:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580309.226637:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e495ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df9f expref: 147 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226665:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49614 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df9f expref: 146 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.226673:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa024ae57be00) 00010000:00010000:2.0:1777580309.226676:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580309.226679:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9ae00, rc 0) 00000100:00100000:2.0:1777580309.226932:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282895:x1863919946564864:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3663us (4765us total) trans 8589950513 rc 0/0 00000100:00100000:2.0:1777580309.226959:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19214 00000100:00100000:2.0:1777580309.226970:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830171386704 time 7830172118217 state 0x2 ref 0 00010000:00010000:3.0:1777580309.236813:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.236845:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02493bbda00) 00010000:00010000:3.0:1777580309.236848:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.236855:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.236878:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4960d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.236937:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946564992 00000100:00100000:3.0:1777580309.236949:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946564992 00000100:00100000:3.0:1777580309.236994:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830171386704 time 7830172118217 state 0x0 ref 1 00000100:00100000:3.0:1777580309.237011:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830172218217 time 7830172118217 state 0x1 ref 1 00000100:00100000:3.0:1777580309.237041:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830172218217 time 7830185903096 state 0x0 ref 1 00000100:00100000:3.0:1777580309.237060:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:282893:x1863919946564992:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580309.237186:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.237210:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49622 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfa6 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.238420:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49622 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x801:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfa6 expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.238447:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49622 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x801:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfa6 expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.238476:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580309.238490:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580309.238494:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030e00, rc 0) 00000100:00100000:3.0:1777580309.238591:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:282893:x1863919946564992:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1537us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.238602:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19215 00000100:00100000:3.0:1777580309.238610:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830172218217 time 7830185903096 state 0x2 ref 0 00000100:00100000:2.0:1777580309.239954:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.243071:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.243131:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946565248 00000100:00100000:2.0:1777580309.243198:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946565248 00000100:00100000:2.0:1777580309.243250:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830172218217 time 7830185903096 state 0x0 ref 1 00000100:00100000:2.0:1777580309.243265:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830186003096 time 7830185903096 state 0x1 ref 1 00000100:00100000:2.0:1777580309.243287:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946565504 00000100:00100000:2.0:1777580309.243290:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946565504 00000100:00100000:2.0:1777580309.243300:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830125933861 time 7830127438731 state 0x0 ref 1 00000100:00100000:2.0:1777580309.243306:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830127538731 time 7830127438731 state 0x1 ref 1 00000100:00100000:2.0:1777580309.243323:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830127538731 time 7830192185385 state 0x0 ref 1 00000100:00100000:2.0:1777580309.243334:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282872:x1863919946565504:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580309.243411:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1777580309.243437:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830186003096 time 7830192296638 state 0x0 ref 1 00010000:00010000:2.0:1777580309.243447:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49201 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de56 expref: 147 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.243455:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282895:x1863919946565248:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580309.243481:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e49128 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de1e expref: 146 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243493:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f3:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580309.243521:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580309.243526:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580309.243538:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49614 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df9f expref: 145 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.243552:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa024ae57be00) 00010000:00010000:2.0:1777580309.243559:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.243560:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580309.243579:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243592:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243609:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243617:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243625:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.243643:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.243654:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.243662:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243802:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243810:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.243817:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.243864:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007eaaae4b reply state 00000000dd99c213 transno 8589950514 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.243875:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.244004:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:282895:x1863919946565248:12345-192.168.202.9@tcp:36:touch.500 Request processed in 554us (4059us total) trans 8589950514 rc 0/0 00000100:00100000:3.0:1777580309.244013:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19216 00000100:00100000:3.0:1777580309.244020:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830186003096 time 7830192296638 state 0x2 ref 0 00000040:00080000:2.0:1777580309.244404:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1840, 64 off125952 00010000:00010000:2.0:1777580309.244463:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.244475:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.244491:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.244499:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.244505:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.244510:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248600:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580309.248680:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248695:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248702:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248708:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.248714:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248732:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.248752:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f3:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:2.0:1777580309.248755:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580309.249593:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249603:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4963e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0F:1777580309.249622:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.249641:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249649:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580309.249653:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249654:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249674:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249675:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249690:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249696:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.249699:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249699:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f3:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:1.0:1777580309.249706:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.249711:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249712:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249720:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49645 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.249742:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.249744:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.249746:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.249913:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.249916:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.249920:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.249926:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49629 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.249939:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005004106d reply state 00000000ebf3a80f transno 8589950515 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.249963:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580309.250320:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282872:x1863919946565504:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6981us (7256us total) trans 8589950515 rc 0/0 00000100:00100000:2.0:1777580309.250333:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19217 00000100:00100000:2.0:1777580309.250342:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830127538731 time 7830192185385 state 0x2 ref 0 00000100:00100000:3.0:1777580309.250639:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.250826:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946565632 00000100:00100000:1.0:1777580309.250838:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946565632 00000100:00100000:1.0:1777580309.250911:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11757 00000100:00100000:1.0:1777580309.250921:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2364:x1863919946565632:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580309.251454:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2364:x1863919946565632:12345-192.168.202.9@tcp:2:touch.500 Request processed in 533us (815us total) trans 8589938548 rc 0/0 00000100:00100000:1.0:1777580309.251465:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11757 00000100:00100000:3.0:1777580309.258661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.258742:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.258782:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946565888 00000100:00100000:3.0:1777580309.258794:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946565888 00000100:00100000:3.0:1777580309.258851:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4125 00000100:00100000:3.0:1777580309.258873:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282893:x1863919946565888:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580309.259340:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:282893:x1863919946565888:12345-192.168.202.9@tcp:35:touch.500 Request processed in 467us (690us total) trans 8589950516 rc 0/0 00000100:00100000:3.0:1777580309.259349:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4125 00010000:00010000:3.0:1777580309.259387:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259400:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259409:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259415:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.259420:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259429:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259462:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:3.0:1777580309.259465:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.259470:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259478:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49637 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259510:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259517:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259523:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259527:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.259530:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259536:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259543:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024ae57b000) 00010000:00010000:3.0:1777580309.259545:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.259548:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259553:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e49630 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.259668:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946566016 00000100:00100000:3.0:1777580309.259674:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946566016 00000100:00100000:3.0:1777580309.259698:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830186003096 time 7830192296638 state 0x0 ref 1 00000100:00100000:3.0:1777580309.259709:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192396638 time 7830192296638 state 0x1 ref 1 00000100:00100000:3.0:1777580309.259738:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192396638 time 7830208599573 state 0x0 ref 1 00000100:00100000:3.0:1777580309.259748:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:282895:x1863919946566016:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580309.259763:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.259781:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4964c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfad expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259831:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4964c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x802:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfad expref: 147 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259847:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4964c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x802:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfad expref: 147 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.259879:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa02483f8ef00) 00010000:00010000:3.0:1777580309.259883:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580309.259885:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:3.0:1777580309.259912:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282895:x1863919946566016:12345-192.168.202.9@tcp:101:touch.500 Request processed in 165us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.259920:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19218 00000100:00100000:3.0:1777580309.259925:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192396638 time 7830208599573 state 0x2 ref 0 00000100:00100000:2.0:1777580309.267546:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.267599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.271832:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946566272 00000100:00100000:3.0:1777580309.271855:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946566272 00000100:00100000:3.0:1777580309.271921:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192396638 time 7830208599573 state 0x0 ref 1 00000100:00100000:3.0:1777580309.271937:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830208699573 time 7830208599573 state 0x1 ref 1 00000100:00100000:0.0F:1777580309.272154:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.274371:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946566528 00000100:00100000:3.0:1777580309.274390:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946566528 00000100:00100000:2.0:1777580309.274429:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830208699573 time 7830223285439 state 0x0 ref 1 00000100:00100000:3.0:1777580309.274451:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830223385439 time 7830223285439 state 0x1 ref 2 00000100:00100000:2.0:1777580309.274460:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:282918:x1863919946566272:12345-192.168.202.9@tcp:101:touch.500 00000100:00100000:3.0:1777580309.274483:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7830223385439 time 7830223345573 state 0x0 ref 2 00000100:00100000:3.0:1777580309.274496:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:282897:x1863919946566528:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.274497:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.274511:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.274525:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4965a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfbb expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.274526:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49653 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfb4 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275004:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275025:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275040:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275169:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275179:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.275203:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275410:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275423:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275431:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275447:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275454:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.275470:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580309.276098:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1598:0x0], index 1: 0 00000100:00100000:1.0:1777580309.276504:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946566656 00000100:00100000:1.0:1777580309.276518:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946566656 00000100:00100000:1.0:1777580309.276593:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11758 00000100:00100000:1.0:1777580309.276604:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946566656:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580309.276972:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946566656:12345-192.168.202.9@tcp:2:touch.500 Request processed in 370us (4846us total) trans 8589938948 rc 0/0 00000100:00100000:1.0:1777580309.276981:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11758 00000004:00080000:2.0:1777580309.282875:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15bd:0x0], index 0: 0 00010000:00010000:3.0:1777580309.283182:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4967d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283205:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4967d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283221:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4967d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283348:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49684 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283358:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49684 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283366:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49684 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283403:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283410:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283418:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283424:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.283429:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283432:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283443:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283450:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283452:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283459:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.283466:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283472:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.283476:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.283493:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283495:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283507:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.283510:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.283521:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283528:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4966f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.283549:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d01af482 reply state 000000003e9ae11f transno 8589950517 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.283560:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580309.283609:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4965a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfbb expref: 150 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283625:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e49661 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283631:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4967d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfbb expref: 149 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283640:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02483f8e500) 00000004:00010000:2.0:1777580309.283642:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cd40204a reply state 00000000590f2398 transno 8589950518 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.283643:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.283646:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee9200, rc 0) 00000100:00100000:2.0:1777580309.283661:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580309.283688:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e49653 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfb4 expref: 384 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283702:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49684 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfb4 expref: 383 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.283709:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:2.0:1777580309.283712:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1777580309.283740:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282897:x1863919946566528:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9246us (16140us total) trans 8589950517 rc 0/0 00000100:00100000:3.0:1777580309.283751:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19220 00010000:00010000:2.0:1777580309.284204:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680fe00, rc 0) 00000100:00100000:2.0:1777580309.284265:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+384:282918:x1863919946566272:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9818us (16733us total) trans 8589950518 rc 0/0 00000100:00100000:2.0:1777580309.284272:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19219 00000100:00100000:2.0:1777580309.284280:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7830223385439 time 7830223345573 state 0x2 ref 0 00010000:00010000:3.0:1777580309.287222:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288423:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288441:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288468:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.288473:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288483:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288505:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024ae57b600) 00010000:00010000:3.0:1777580309.288508:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.288515:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.288522:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e49668 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290383:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290405:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290414:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290421:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.290427:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290435:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290454:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02483f8e700) 00010000:00010000:1.0:1777580309.290458:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.290462:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.290469:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49676 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.291929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.292411:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946567168 00000100:00100000:1.0:1777580309.292432:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946567168 00000100:00100000:1.0:1777580309.292484:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7830223385439 time 7830223345573 state 0x0 ref 1 00000100:00100000:1.0:1777580309.292500:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7830223445573 time 7830223345573 state 0x1 ref 1 00000100:00100000:1.0:1777580309.292542:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830223445573 time 7830241403718 state 0x0 ref 1 00000100:00100000:1.0:1777580309.292557:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:282918:x1863919946567168:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.292652:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.292683:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e49684 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfb4 expref: 383 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.292704:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:1.0:1777580309.292715:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.292810:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.292826:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.292837:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.293033:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008643bfa4 reply state 00000000aadffad3 transno 8589950519 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.293044:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.293466:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+384:282918:x1863919946567168:12345-192.168.202.9@tcp:36:touch.500 Request processed in 909us (1545us total) trans 8589950519 rc 0/0 00000100:00100000:1.0:1777580309.293477:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19221 00000100:00100000:1.0:1777580309.293492:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830223445573 time 7830241403718 state 0x2 ref 0 00000100:00100000:0.0:1777580309.305783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.306629:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.306671:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.306869:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946566912 00000100:00100000:3.0:1777580309.306882:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946566912 00000100:00100000:3.0:1777580309.306932:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830223445573 time 7830241403718 state 0x0 ref 1 00000100:00100000:3.0:1777580309.307020:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830241503718 time 7830241403718 state 0x1 ref 1 00000100:00100000:3.0:1777580309.307042:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946567296 00000100:00100000:3.0:1777580309.307045:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946567296 00000100:00100000:3.0:1777580309.307059:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830127538731 time 7830192185385 state 0x0 ref 1 00000100:00100000:3.0:1777580309.307066:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192285385 time 7830192185385 state 0x1 ref 1 00000100:00100000:3.0:1777580309.307097:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192285385 time 7830255958862 state 0x0 ref 1 00000100:00100000:3.0:1777580309.307111:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282864:x1863919946567296:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.307184:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.307261:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e496a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfc2 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307351:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307369:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307383:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307402:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307409:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307417:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307522:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307530:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307537:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307543:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.307555:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307564:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307577:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.307581:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.307586:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307593:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e496a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307608:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307614:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307620:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307625:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.307628:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307634:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.307640:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02483f8e600) 00010000:00010000:3.0:1777580309.307643:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.307652:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.310550:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e496ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.310646:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e496a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfc2 expref: 151 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.310665:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.310668:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.310674:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e496a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfc2 expref: 151 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.310684:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000100:00100000:3.0:1777580309.310807:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282864:x1863919946567296:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3698us (4181us total) trans 0 rc 301/301 00000100:00100000:3.0:1777580309.310818:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19223 00000100:00100000:3.0:1777580309.310828:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192285385 time 7830255958862 state 0x2 ref 0 00000100:00100000:3.0:1777580309.310893:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830241503718 time 7830259754226 state 0x0 ref 1 00000100:00100000:3.0:1777580309.310912:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282897:x1863919946566912:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580309.310975:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580309.310994:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4967d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfbb expref: 149 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.311007:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02483f8e500) 00010000:00010000:3.0:1777580309.311031:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580309.311123:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580309.311124:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.311153:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.311167:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.311373:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009797c815 reply state 000000001496b545 transno 8589950520 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.312918:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946567808 00000100:00100000:1.0:1777580309.312941:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946567808 00000100:00100000:1.0:1777580309.313011:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830259854226 time 7830259754226 state 0x1 ref 2 00000100:00100000:1.0:1777580309.313056:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830259854226 time 7830261918625 state 0x0 ref 2 00000100:00100000:1.0:1777580309.313075:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+384:282920:x1863919946567808:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.313100:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.313126:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e496bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfc9 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.313736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.313781:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.313803:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.313811:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946567936 00010000:00010000:1.0:1777580309.313817:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.313819:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946567936 00010000:00010000:1.0:1777580309.313839:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.313846:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.313853:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.313872:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262018625 time 7830261918625 state 0x1 ref 3 00000100:00100000:0.0:1777580309.313897:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262018625 time 7830262760494 state 0x0 ref 3 00000100:00100000:0.0:1777580309.313908:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:282918:x1863919946567936:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.313927:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.313941:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e496d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfd0 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.313988:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e496d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd0 expref: 387 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.314002:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e496d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd0 expref: 387 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.314026:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024997a0a00) 00010000:00010000:0.0:1777580309.314030:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580309.314034:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f400, rc 0) 00000100:00100000:0.0:1777580309.314117:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:282918:x1863919946567936:12345-192.168.202.9@tcp:101:touch.500 Request processed in 210us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580309.314155:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19225 00000004:00080000:1.0:1777580309.314626:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1599:0x0], index 1: 0 00010000:00010000:1.0:1777580309.314844:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e496d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314866:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e496d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314875:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e496d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314922:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314930:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314937:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314944:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.314950:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314958:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314971:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.314973:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.314978:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.314997:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e496c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.315015:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021fdc50f reply state 00000000b0466db8 transno 8589950521 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.315025:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580309.315067:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e496bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfc9 expref: 388 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315081:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e496d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfc9 expref: 387 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315088:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580309.315091:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.315093:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50600, rc 0) 00000100:00100000:1.0:1777580309.315194:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:282920:x1863919946567808:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2125us (4071us total) trans 8589950521 rc 0/0 00000100:00100000:1.0:1777580309.315204:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19224 00000100:00100000:2.0:1777580309.315205:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946567552 00000100:00100000:2.0:1777580309.315216:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946567552 00010000:00010000:1.0:1777580309.315248:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315257:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315263:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315268:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:2.0:1777580309.315278:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4126 00010000:00010000:1.0:1777580309.315279:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315288:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.315294:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282895:x1863919946567552:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580309.315305:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024997a0a00) 00010000:00010000:1.0:1777580309.315309:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.315312:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.315318:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49699 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.317591:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282895:x1863919946567552:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2289us (10904us total) trans 8589950522 rc 0/0 00000100:00100000:2.0:1777580309.317632:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4126 00000100:00100000:3.0:1777580309.324504:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.324723:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282897:x1863919946566912:12345-192.168.202.9@tcp:36:touch.500 Request processed in 13808us (18954us total) trans 8589950520 rc 0/0 00000100:00100000:3.0:1777580309.324737:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19222 00000100:00100000:3.0:1777580309.324747:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262018625 time 7830262760494 state 0x2 ref 0 00000100:00100000:0.0:1777580309.337242:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.337295:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.337328:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946568320 00000100:00100000:0.0:1777580309.337340:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946568320 00000100:00100000:0.0:1777580309.337395:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262018625 time 7830262760494 state 0x0 ref 1 00000100:00100000:0.0:1777580309.337414:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262860494 time 7830262760494 state 0x1 ref 1 00000100:00100000:0.0:1777580309.337444:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262860494 time 7830286305499 state 0x0 ref 1 00000100:00100000:0.0:1777580309.337458:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282902:x1863919946568320:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.337486:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.340318:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e496e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfd7 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.343416:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946568064 00000100:00100000:2.0:1777580309.343436:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946568064 00000100:00100000:2.0:1777580309.343533:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11759 00000100:00100000:2.0:1777580309.343550:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2364:x1863919946568064:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580309.343732:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.343758:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.343773:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.343795:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.343803:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.343826:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.344194:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2364:x1863919946568064:12345-192.168.202.9@tcp:2:touch.500 Request processed in 648us (6964us total) trans 8589938949 rc 0/0 00000100:00100000:2.0:1777580309.344202:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11759 00000100:00080000:3.0:1777580309.345572:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1777580309.350055:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15be:0x0], index 0: 0 00010000:00010000:0.0:1777580309.350414:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e496fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.350449:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e496fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.350464:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e496fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353034:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353055:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353065:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353073:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.353078:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353088:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353109:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.353113:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.353147:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353155:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e496ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.353179:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000739c9014 reply state 000000008a2c1af9 transno 8589950523 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.353190:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.353264:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e496e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd7 expref: 154 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353298:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e496fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd7 expref: 153 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.353307:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa02497a21f00) 00010000:00010000:0.0:1777580309.353310:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.353314:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:0.0:1777580309.353410:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282902:x1863919946568320:12345-192.168.202.9@tcp:101:touch.500 Request processed in 15953us (16112us total) trans 8589950523 rc 0/0 00000100:00100000:0.0:1777580309.353424:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19226 00000100:00100000:0.0:1777580309.353435:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262860494 time 7830286305499 state 0x2 ref 0 00000100:00100000:3.0:1777580309.361491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.361516:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.361551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.361654:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361670:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361679:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361685:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.361690:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361698:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361718:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02493bbda00) 00010000:00010000:1.0:1777580309.361721:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.361738:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.361745:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e496b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.361798:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946568448 00000100:00100000:1.0:1777580309.361810:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946568448 00000100:00100000:1.0:1777580309.361866:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830262860494 time 7830286305499 state 0x0 ref 1 00000100:00100000:1.0:1777580309.361881:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830286405499 time 7830286305499 state 0x1 ref 1 00000100:00100000:1.0:1777580309.361902:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946568704 00000100:00100000:1.0:1777580309.361905:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946568704 00000100:00100000:1.0:1777580309.361921:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830286405499 time 7830286305499 state 0x1 ref 2 00000100:00100000:1.0:1777580309.361937:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946568960 00000100:00100000:1.0:1777580309.361940:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946568960 00000100:00100000:1.0:1777580309.361952:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830286405499 time 7830286305499 state 0x1 ref 3 00000100:00100000:1.0:1777580309.361973:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830310935273 time 7830310835273 state 0x1 ref 3 00000100:00100000:1.0:1777580309.361987:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:282897:x1863919946568448:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.362020:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.362042:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49709 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfde expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362112:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49709 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x803:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfde expref: 154 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362127:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49709 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x803:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfde expref: 154 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362178:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02486090600) 00010000:00010000:1.0:1777580309.362182:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.362186:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51800, rc 0) 00000100:00100000:1.0:1777580309.362271:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282897:x1863919946568448:12345-192.168.202.9@tcp:101:touch.500 Request processed in 285us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.362281:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19227 00000100:00100000:1.0:1777580309.362321:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311284522 time 7830311184522 state 0x1 ref 2 00000100:00100000:1.0:1777580309.362333:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:282920:x1863919946568704:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.362384:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.362405:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e496d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfc9 expref: 388 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362421:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580309.362438:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.362508:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362519:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.362529:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.362724:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a3655b4d reply state 000000004d1084a3 transno 8589950524 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.362744:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.362805:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:282920:x1863919946568704:12345-192.168.202.9@tcp:36:touch.500 Request processed in 474us (1287us total) trans 8589950524 rc 0/0 00000100:00100000:1.0:1777580309.362812:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19228 00000100:00100000:1.0:1777580309.362831:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311284522 time 7830311693177 state 0x0 ref 1 00000100:00100000:1.0:1777580309.362841:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:282922:x1863919946568960:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.362850:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.362872:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49717 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfe5 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363019:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363031:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363039:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363054:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363061:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363066:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363178:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4972c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363188:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4972c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363195:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4972c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.363205:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7f4:0x0]: returning size 0 00010000:00010000:1.0:1777580309.363274:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363284:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363290:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363296:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.363300:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363307:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363318:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.363322:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.363326:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363343:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4971e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363360:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363367:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363373:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363379:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.363384:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363391:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363401:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02486090900) 00010000:00010000:1.0:1777580309.363404:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.363408:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363414:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49725 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363462:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49717 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfe5 expref: 391 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363491:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4972c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfe5 expref: 390 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.363500:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:1.0:1777580309.363503:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.363507:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00000100:00100000:1.0:1777580309.363545:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:282922:x1863919946568960:12345-192.168.202.9@tcp:101:touch.500 Request processed in 704us (1991us total) trans 8589950525 rc 0/0 00000100:00100000:1.0:1777580309.363555:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19229 00000100:00100000:1.0:1777580309.363561:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311284522 time 7830311693177 state 0x2 ref 0 00000100:00100000:0.0:1777580309.365009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580309.373421:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373447:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373456:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373482:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.373489:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373497:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373520:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02497a21600) 00010000:00010000:3.0:1777580309.373524:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.373530:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373538:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e496f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373582:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373589:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373595:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373600:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.373603:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373610:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373630:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024997a0b00) 00010000:00010000:3.0:1777580309.373633:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.373636:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.373642:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e496ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.390227:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569216 00000100:00100000:3.0:1777580309.390247:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569216 00000100:00100000:3.0:1777580309.390336:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4127 00000100:00100000:3.0:1777580309.390349:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:282918:x1863919946569216:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580309.390854:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:282918:x1863919946569216:12345-192.168.202.9@tcp:35:touch.500 Request processed in 506us (25853us total) trans 8589950526 rc 0/0 00000100:00100000:3.0:1777580309.390875:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4127 00000100:00100000:0.0:1777580309.393695:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.393736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.393759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.393790:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.393809:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.394419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.404369:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.405044:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569472 00000100:00100000:1.0:1777580309.405060:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569472 00000100:00100000:1.0:1777580309.405120:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311284522 time 7830311693177 state 0x0 ref 1 00000100:00100000:1.0:1777580309.405150:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311793177 time 7830311693177 state 0x1 ref 1 00000100:00100000:1.0:1777580309.405177:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569728 00000100:00100000:1.0:1777580309.405181:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569728 00000100:00100000:1.0:1777580309.405196:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830192285385 time 7830255958862 state 0x0 ref 1 00000100:00100000:1.0:1777580309.405203:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830256058862 time 7830255958862 state 0x1 ref 1 00000100:00100000:1.0:1777580309.405219:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569600 00000100:00100000:1.0:1777580309.405223:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569600 00000100:00100000:1.0:1777580309.405235:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830256058862 time 7830255958862 state 0x1 ref 2 00000100:00100000:1.0:1777580309.405382:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946570112 00000100:00100000:1.0:1777580309.405402:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946570112 00000100:00100000:1.0:1777580309.405419:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830256058862 time 7830255958862 state 0x1 ref 3 00000100:00100000:1.0:1777580309.405428:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946570240 00000100:00100000:1.0:1777580309.405432:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946570240 00000100:00100000:1.0:1777580309.405442:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830256058862 time 7830255958862 state 0x1 ref 4 00000100:00100000:1.0:1777580309.405450:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569856 00000100:00100000:1.0:1777580309.405453:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569856 00000100:00100000:1.0:1777580309.405462:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830256058862 time 7830255958862 state 0x1 ref 5 00000100:00100000:1.0:1777580309.405476:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830354438953 time 7830354338953 state 0x1 ref 5 00000100:00100000:1.0:1777580309.405491:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:282921:x1863919946569728:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.405544:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.405572:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4973a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dfec expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405661:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405681:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405696:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405715:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405723:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.405737:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406129:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406170:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406179:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.406218:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x801:0x0]: returning size 0 00000004:00200000:1.0:1777580309.406223:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1777580309.406469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.406489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.406518:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:1.0:1777580309.406519:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406535:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406540:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.406546:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406553:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406559:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406565:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839400 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:0.0:1777580309.406568:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946570624 00010000:00010000:1.0:1777580309.406570:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406575:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946570624 00010000:00010000:1.0:1777580309.406587:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406601:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00000100:00100000:0.0:1777580309.406603:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311793177 time 7830311693177 state 0x1 ref 2 00010000:00010000:1.0:1777580309.406604:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.406610:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406613:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946570752 00000100:00100000:0.0:1777580309.406615:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946570752 00010000:00010000:1.0:1777580309.406617:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e49741 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406624:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311793177 time 7830311693177 state 0x1 ref 3 00000100:00100000:0.0:1777580309.406630:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571008 00000100:00100000:0.0:1777580309.406632:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571008 00010000:00010000:1.0:1777580309.406634:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406640:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406640:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830311793177 time 7830311693177 state 0x1 ref 4 00010000:00010000:1.0:1777580309.406647:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406647:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946569984 00000100:00100000:0.0:1777580309.406649:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946569984 00010000:00010000:1.0:1777580309.406653:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.406656:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406656:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830354438953 time 7830354338953 state 0x1 ref 6 00010000:00010000:1.0:1777580309.406662:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406668:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830355631328 time 7830355531328 state 0x1 ref 4 00010000:00010000:1.0:1777580309.406669:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02483f8e500) 00010000:00010000:1.0:1777580309.406671:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.406674:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.406678:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282902:x1863919946569472:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.406684:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e49748 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.406719:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.406723:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4973a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfec expref: 161 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.406734:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e496fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd7 expref: 160 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406738:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfec expref: 160 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.406745:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa02499479b00) 00010000:00010000:1.0:1777580309.406747:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.406748:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa02497a21f00) 00010000:00010000:1.0:1777580309.406751:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839c00, rc 0) 00010000:00010000:0.0:1777580309.406761:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.406845:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.406863:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.406872:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.407037:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000083e6c122 reply state 000000009a6d4483 transno 8589950527 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.407047:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.407130:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282902:x1863919946569472:12345-192.168.202.9@tcp:36:touch.500 Request processed in 451us (13449us total) trans 8589950527 rc 0/0 00000100:00100000:0.0:1777580309.407171:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19230 00000100:00100000:0.0:1777580309.407199:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830356161424 time 7830356061424 state 0x1 ref 6 00000100:00100000:0.0:1777580309.407209:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282912:x1863919946569600:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580309.407222:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.407234:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4975d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dff3 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407278:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407298:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407306:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407328:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407336:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407343:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.407391:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282921:x1863919946569728:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1904us (13653us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.407398:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19231 00000100:00100000:1.0:1777580309.407418:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830356380673 time 7830356280673 state 0x1 ref 3 00000100:00100000:1.0:1777580309.407427:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:282922:x1863919946570624:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580309.407437:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407446:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407449:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580309.407452:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407463:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4972c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfe5 expref: 392 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580309.407473:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7fd:0x0]: returning size 0 00010000:00010000:1.0:1777580309.407475:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00000004:00200000:0.0:1777580309.407476:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1777580309.407478:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1777580309.407488:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407496:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407503:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407508:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407524:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407525:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407531:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea3800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.407535:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407542:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407545:0:205909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407549:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.407552:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.407554:0:205909:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407554:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407561:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49764 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407573:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407578:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407582:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407587:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.407589:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407594:0:205909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407603:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407609:0:205909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407610:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02497a21e00) 00010000:00010000:0.0:1777580309.407612:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.407615:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407621:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4976b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.407624:0:205909:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205909:1863919917458432:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580309.407643:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4975d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dff3 expref: 161 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407653:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dff3 expref: 160 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407660:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fd:0x0].0x0 (ffffa024185ac900) 00010000:00010000:0.0:1777580309.407662:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.407665:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c200, rc 0) 00000100:00100000:0.0:1777580309.407685:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282912:x1863919946569600:12345-192.168.202.9@tcp:101:rm.500 Request processed in 477us (13925us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.407687:0:205909:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777580309.407691:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19232 00000100:00100000:0.0:1777580309.407705:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830356668752 time 7830356568752 state 0x1 ref 4 00000100:00100000:1.0:1777580309.407715:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830356677011 time 7830356577011 state 0x1 ref 3 00000100:00100000:0.0:1777580309.407715:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282914:x1863919946570112:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580309.407723:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777580309.407725:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:282920:x1863919946570752:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.407734:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.407739:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49780 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e008 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.407741:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49787 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e016 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407786:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407794:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407801:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407812:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407818:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407824:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.407873:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946570368 00000100:00100000:2.0:1777580309.407882:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946570368 00010000:00010000:0.0:1777580309.407897:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407906:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407914:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580309.407935:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7ff:0x0]: returning size 0 00000100:00100000:2.0:1777580309.407936:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11760 00000004:00200000:0.0:1777580309.407942:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1777580309.407949:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2362:x1863919946570368:12345-192.168.202.9@tcp:2:touch.500 00000004:00010000:0.0:1777580309.407954:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407970:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407978:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407984:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407989:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.407994:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.407997:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408003:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408012:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.408015:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.408018:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408024:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4978e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408035:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408042:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408054:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408060:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.408063:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408069:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49787 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e016 expref: 392 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408070:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408079:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02497a21b00) 00010000:00010000:0.0:1777580309.408081:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.408083:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49787 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e016 expref: 392 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408084:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408091:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49795 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408115:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49780 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e008 expref: 161 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408116:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090400) 00010000:00010000:1.0:1777580309.408118:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.408121:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838400, rc 0) 00010000:00010000:0.0:1777580309.408127:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e008 expref: 160 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.408155:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7ff:0x0].0x0 (ffffa02490544200) 00010000:00010000:0.0:1777580309.408157:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.408160:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c800, rc 0) 00000100:00100000:1.0:1777580309.408169:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:282920:x1863919946570752:12345-192.168.202.9@tcp:101:touch.500 Request processed in 445us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.408177:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19237 00000100:00100000:0.0:1777580309.408180:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282914:x1863919946570112:12345-192.168.202.9@tcp:101:rm.500 Request processed in 468us (14391us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.408196:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830357160051 time 7830357060051 state 0x1 ref 4 00000100:00100000:0.0:1777580309.408204:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19233 00000100:00100000:1.0:1777580309.408207:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282916:x1863919946570240:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.408216:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1777580309.408220:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830356677011 time 7830357083559 state 0x0 ref 2 00010000:00010000:1.0:1777580309.408226:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e497a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e00f expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.408231:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:282925:x1863919946571008:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.408240:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.408248:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e497aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e01d expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408274:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.408315:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946570368:12345-192.168.202.9@tcp:2:touch.500 Request processed in 367us (3961us total) trans 8589938549 rc 0/0 00010000:00010000:0.0:1777580309.408321:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.408326:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11760 00010000:00010000:1.0:1777580309.408384:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408396:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408412:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408421:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408440:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408511:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408521:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408529:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.408551:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x800:0x0]: returning size 0 00000004:00200000:1.0:1777580309.408554:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580309.408566:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.408575:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.411003:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.411036:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.411077:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.411086:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.411093:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.412486:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830361439563 time 7830361339563 state 0x1 ref 3 00000100:00100000:3.0:1777580309.412970:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282913:x1863919946569856:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.413001:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.413029:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e497d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90dffa expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413113:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413130:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413183:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413206:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413214:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.413221:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414210:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414226:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414237:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580309.414280:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7fe:0x0]: returning size 0 00000004:00200000:3.0:1777580309.414349:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580309.414377:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414392:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414404:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414427:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414445:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414453:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.414460:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414470:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414486:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.414490:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.414581:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414591:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e497db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414614:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414621:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414627:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414635:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.414645:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414652:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414663:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024185ac100) 00010000:00010000:3.0:1777580309.414666:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.414670:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414677:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e497e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414730:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e497d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dffa expref: 162 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414753:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dffa expref: 161 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.414762:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fe:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580309.414765:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.414768:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000004:00080000:0.0:1777580309.415799:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159a:0x0], index 1: 0 00010000:00010000:0.0:1777580309.416096:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e497f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416131:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e497f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416168:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e497f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416218:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416227:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416234:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416242:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1c400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.416246:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416254:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.416267:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.416271:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.416276:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.416617:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282913:x1863919946569856:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3657us (22193us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.416632:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19235 00000100:00100000:3.0:1777580309.416686:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830361439563 time 7830365545442 state 0x0 ref 2 00000100:00100000:3.0:1777580309.416706:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282924:x1863919946569984:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.416739:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.416756:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e497fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e001 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.417364:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c400/0xcb2b2f2f7e497b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.417393:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002ad67a66 reply state 00000000f895d0f9 transno 8589950528 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.417414:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.417465:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e497aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e01d expref: 394 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.417486:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e497f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e01d expref: 393 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.417495:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:0.0:1777580309.417579:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.417584:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fde00, rc 0) 00010000:00010000:1.0:1777580309.417623:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417633:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417640:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417645:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.417650:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.417650:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282925:x1863919946571008:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9420us (11130us total) trans 8589950528 rc 0/0 00000100:00100000:0.0:1777580309.417658:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19238 00010000:00010000:1.0:1777580309.417665:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417677:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.417680:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.417683:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417688:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e497b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417702:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417708:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417713:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417718:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.417720:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417726:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417733:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02483f8e600) 00010000:00010000:1.0:1777580309.417735:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.417738:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417749:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e497bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417800:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e497a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e00f expref: 162 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417813:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e00f expref: 161 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.417821:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x800:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580309.417823:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.417827:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839a00, rc 0) 00000100:00100000:1.0:1777580309.417850:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282916:x1863919946570240:12345-192.168.202.9@tcp:101:rm.500 Request processed in 9645us (24040us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.417869:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19234 00010000:00010000:3.0:1777580309.417988:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418003:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418014:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418033:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418040:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418046:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418187:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418195:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418200:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418201:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418207:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.418209:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418211:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.418217:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418217:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418232:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090400) 00010000:00010000:1.0:1777580309.418234:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.418237:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.418242:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49710 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580309.418249:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x802:0x0]: returning size 0 00000004:00200000:3.0:1777580309.418259:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580309.418281:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419718:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419734:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419742:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419750:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419757:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.419762:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419770:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419787:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.419790:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.419795:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419801:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49805 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419820:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419843:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419851:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419866:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.419870:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419878:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419889:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024185aa300) 00010000:00010000:3.0:1777580309.419892:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.419896:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419902:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e4980c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419965:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e497fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e001 expref: 161 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419984:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e001 expref: 160 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.419992:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa02483f8ef00) 00010000:00010000:3.0:1777580309.419994:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.420004:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6400, rc 0) 00000100:00100000:3.0:1777580309.420101:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282924:x1863919946569984:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3401us (13558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.420113:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19239 00000100:00100000:3.0:1777580309.420122:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830361439563 time 7830365545442 state 0x2 ref 0 00010000:00010000:0.0:1777580309.421877:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421896:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421904:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421911:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.421917:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421925:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421963:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa02497a21a00) 00010000:00010000:0.0:1777580309.421966:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.421971:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.421979:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49756 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.427050:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.427103:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571136 00000100:00100000:0.0:1777580309.427115:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571136 00000100:00100000:0.0:1777580309.427187:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830357183559 time 7830357083559 state 0x1 ref 2 00000100:00100000:0.0:1777580309.427219:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830357183559 time 7830376080982 state 0x0 ref 2 00000100:00100000:0.0:1777580309.427232:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282902:x1863919946571136:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.427267:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.427310:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4981a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e024 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.427392:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4981a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e024 expref: 160 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.427410:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4981a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e024 expref: 160 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.427445:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:0.0:1777580309.427449:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580309.427473:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd600, rc 0) 00000100:00100000:0.0:1777580309.427629:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282902:x1863919946571136:12345-192.168.202.9@tcp:101:touch.500 Request processed in 398us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580309.427638:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19240 00010000:00010000:1.0:1777580309.427991:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428002:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428010:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428016:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.428022:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428031:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428046:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02497a21000) 00010000:00010000:1.0:1777580309.428049:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.428054:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.428062:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e497cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.429580:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.429625:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.429671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.429734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.429746:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571392 00000100:00100000:2.0:1777580309.429759:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571392 00000100:00100000:0.0:1777580309.429764:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.429792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.429817:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.429831:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11761 00000100:00100000:2.0:1777580309.429845:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946571392:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.429876:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.429907:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e032 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.429943:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1596:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.429969:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.429978:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.429989:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.430010:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.430026:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680e600, rc 0) 00000100:00100000:2.0:1777580309.430818:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946571392:12345-192.168.202.9@tcp:101:rm.500 Request processed in 969us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.430829:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11761 00000100:00100000:2.0:1777580309.430872:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571264 00000100:00100000:2.0:1777580309.430879:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571264 00000100:00100000:2.0:1777580309.430913:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571904 00000100:00100000:2.0:1777580309.430916:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571904 00000100:00100000:2.0:1777580309.430940:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11762 00000100:00100000:2.0:1777580309.430949:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946571264:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.430961:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.430980:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e02b expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.431004:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1595:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.431025:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.431028:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.431036:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 43 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.431052:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 43 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.431309:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f800, rc 0) 00000100:00100000:0.0:1777580309.432163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.432215:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.432256:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571648 00000100:00100000:0.0:1777580309.432265:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571648 00000100:00100000:0.0:1777580309.432329:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830376180982 time 7830376080982 state 0x1 ref 2 00000100:00100000:0.0:1777580309.432357:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572416 00000100:00100000:0.0:1777580309.432362:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572416 00000100:00100000:0.0:1777580309.432378:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830361439563 time 7830365545442 state 0x0 ref 1 00000100:00100000:0.0:1777580309.432386:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830365645442 time 7830365545442 state 0x1 ref 1 00000100:00100000:0.0:1777580309.432408:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830365645442 time 7830381269939 state 0x0 ref 1 00000100:00100000:0.0:1777580309.432422:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:282926:x1863919946572416:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580309.432465:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.432491:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4982f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e047 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432795:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432815:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432943:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432967:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432976:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.432984:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433169:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433179:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433188:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580309.433224:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d2:0x0]: returning size 0 00000004:00200000:0.0:1777580309.433229:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580309.433256:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433298:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433309:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433318:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433326:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433333:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.433339:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433347:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433361:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.433365:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.433370:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433378:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49836 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433397:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433404:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433417:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433423:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.433426:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433433:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433441:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02488b85600) 00010000:00010000:0.0:1777580309.433443:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.433446:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433453:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4983d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433492:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4982f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e047 expref: 395 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433769:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e047 expref: 394 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.433778:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024997a0a00) 00010000:00010000:0.0:1777580309.433781:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.433784:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:0.0:1777580309.433982:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282926:x1863919946572416:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1560us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580309.434003:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19242 00000100:00100000:0.0:1777580309.434011:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830365645442 time 7830381269939 state 0x2 ref 0 00000100:00100000:0.0:1777580309.434055:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830376180982 time 7830382917789 state 0x0 ref 2 00000100:00100000:0.0:1777580309.434071:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:282925:x1863919946571648:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580309.434119:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580309.434164:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e497f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e01d expref: 393 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.434177:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:0.0:1777580309.434187:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.434267:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.434278:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.434364:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.434452:0:205909:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205909:1863919917458432:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580309.434482:0:205909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.434807:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005f035cd1 reply state 00000000200544e5 transno 8589950529 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.434819:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.434922:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282925:x1863919946571648:12345-192.168.202.9@tcp:36:touch.500 Request processed in 854us (5249us total) trans 8589950529 rc 0/0 00000100:00100000:0.0:1777580309.434930:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19241 00000100:00100000:2.0:1777580309.435915:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946571264:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4957us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.435930:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11762 00000100:00100000:2.0:1777580309.435968:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946571776 00000100:00100000:2.0:1777580309.435977:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946571776 00000100:00100000:2.0:1777580309.436024:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572544 00000100:00100000:2.0:1777580309.436028:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572544 00000100:00100000:2.0:1777580309.436066:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11763 00000100:00100000:2.0:1777580309.436077:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2361:x1863919946571904:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.436094:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.436118:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e039 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.436167:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15bb:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.436191:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.436194:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.436205:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.436225:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.436240:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680ee00, rc 0) 00000100:00100000:2.0:1777580309.436275:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946571904:12345-192.168.202.9@tcp:101:rm.500 Request processed in 202us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.436290:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11763 00000100:00100000:2.0:1777580309.436306:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11764 00000100:00100000:2.0:1777580309.436313:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2363:x1863919946571776:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.436320:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.436333:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e040 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.436346:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ba:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.436355:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.436356:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.436361:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.436371:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 42 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.436378:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680fe00, rc 0) 00000100:00100000:2.0:1777580309.436398:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2363:x1863919946571776:12345-192.168.202.9@tcp:101:rm.500 Request processed in 87us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.436405:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11764 00000100:00100000:2.0:1777580309.436420:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11765 00000100:00100000:2.0:1777580309.436427:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2363:x1863919946572544:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580309.441095:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.441191:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.441232:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.441844:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572672 00000100:00100000:2.0:1777580309.441871:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572672 00000100:00100000:2.0:1777580309.441949:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573056 00000100:00100000:2.0:1777580309.441953:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573056 00000100:00100000:2.0:1777580309.441982:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11766 00000100:00100000:2.0:1777580309.441994:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946572672:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.442018:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.442048:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e04e expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.442097:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1597:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.442121:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.442124:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.442151:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 44 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442172:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 44 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442188:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f000, rc 0) 00000100:00100000:2.0:1777580309.442250:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946572672:12345-192.168.202.9@tcp:101:rm.500 Request processed in 259us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.442258:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11766 00000100:00100000:2.0:1777580309.442279:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11767 00000100:00100000:2.0:1777580309.442285:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946573056:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.442292:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.442304:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e055 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.442333:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15bc:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.442347:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.442349:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.442353:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 43 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442366:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 43 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442375:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f400, rc 0) 00000100:00100000:2.0:1777580309.442395:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946573056:12345-192.168.202.9@tcp:101:rm.500 Request processed in 111us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.442401:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11767 00000100:00100000:2.0:1777580309.442430:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572032 00000100:00100000:2.0:1777580309.442435:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572032 00010000:00010000:2.0:1777580309.442458:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.442486:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4330 00000100:00100000:2.0:1777580309.442492:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:2363:x1863919946572032:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580309.442504:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580309.442510:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442523:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442552:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49446 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df0c expref: 160 pid: 205909 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442571:0:189815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:2.0:1777580309.442578:0:189815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442587:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442595:0:189815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.442638:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580309.443283:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:2363:x1863919946572032:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 787us (13545us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.443292:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4330 00000100:00100000:2.0:1777580309.443325:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572288 00000100:00100000:2.0:1777580309.443331:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572288 00000100:00100000:2.0:1777580309.443363:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4128 00000100:00100000:2.0:1777580309.443370:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282897:x1863919946572288:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580309.443446:0:205909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.443458:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.443728:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003a258a6c reply state 0000000014b26d46 transno 8589950530 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.443738:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.443811:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282922:x1863919946570624:12345-192.168.202.9@tcp:36:touch.500 Request processed in 36385us (37345us total) trans 8589950530 rc 0/0 00000100:00100000:1.0:1777580309.443821:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19236 00000100:00100000:1.0:1777580309.443830:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830376180982 time 7830382917789 state 0x2 ref 0 00000100:00100000:1.0:1777580309.443852:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946572928 00000100:00100000:1.0:1777580309.443865:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946572928 00000100:00100000:1.0:1777580309.443883:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830365645442 time 7830381269939 state 0x0 ref 1 00000100:00100000:1.0:1777580309.443892:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830381369939 time 7830381269939 state 0x1 ref 1 00000100:00100000:1.0:1777580309.443914:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830381369939 time 7830392776452 state 0x0 ref 1 00000100:00100000:1.0:1777580309.443922:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282909:x1863919946572928:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.443966:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.443985:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e494b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df2f expref: 161 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444010:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4935f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90debf expref: 160 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444020:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fb:0x0].0x0 (ffffa02417834e00) 00010000:00010000:1.0:1777580309.444029:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.444056:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444070:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444081:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444096:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444102:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.444106:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.445395:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.445419:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.445444:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.449892:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282897:x1863919946572288:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5104us (18712us total) trans 8589950531 rc 0/0 00000100:00100000:2.0:1777580309.449918:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4128 00000100:00100000:3.0:1777580309.450203:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946572544:12345-192.168.202.9@tcp:2:touch.500 Request processed in 13773us (17984us total) trans 8589938550 rc 0/0 00000100:00100000:3.0:1777580309.450216:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11765 00000100:00100000:0.0:1777580309.454126:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580309.454253:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454268:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454276:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454282:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.454288:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454296:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454316:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa02488b85b00) 00010000:00010000:0.0:1777580309.454320:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.454325:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454331:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4984b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.454377:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1841, 64 off126016 00000100:00100000:0.0:1777580309.454404:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.454446:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.454479:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454495:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454507:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454515:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454521:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454526:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454553:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.454583:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454589:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454594:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454616:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.454619:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454624:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454633:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fb:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:1.0:1777580309.454636:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.454638:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454644:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4987c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454665:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454672:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454678:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454684:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.454686:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454692:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454710:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.454711:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.454713:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.454716:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454717:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.454722:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4986e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454729:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580309.454732:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.454736:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008de296be reply state 00000000c738a993 transno 8589950532 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454738:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.454745:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.454746:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fb:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:0.0:1777580309.454748:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580309.454750:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454755:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49883 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.454767:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.454768:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.454770:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580309.454838:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282909:x1863919946572928:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10913us (13645us total) trans 8589950532 rc 0/0 00000100:00100000:1.0:1777580309.454850:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19243 00000100:00100000:1.0:1777580309.454873:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830381369939 time 7830392776452 state 0x2 ref 0 00000100:00100000:1.0:1777580309.454910:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573312 00000100:00100000:1.0:1777580309.454920:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573312 00000100:00100000:1.0:1777580309.454952:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830376180982 time 7830382917789 state 0x0 ref 1 00000100:00100000:1.0:1777580309.454963:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830383017789 time 7830382917789 state 0x1 ref 1 00000100:00100000:1.0:1777580309.454992:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830383017789 time 7830403854098 state 0x0 ref 1 00000100:00100000:1.0:1777580309.455004:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282925:x1863919946573312:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.455025:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.455041:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4988a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e05c expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.455106:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e05c expref: 395 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.455120:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e05c expref: 395 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.455165:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024acb37500) 00010000:00010000:1.0:1777580309.455168:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.455172:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1400, rc 0) 00000100:00100000:1.0:1777580309.455193:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282925:x1863919946573312:12345-192.168.202.9@tcp:101:touch.500 Request processed in 191us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.455199:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19244 00000100:00100000:1.0:1777580309.455203:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830383017789 time 7830403854098 state 0x2 ref 0 00000100:00100000:1.0:1777580309.455232:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573184 00000100:00100000:1.0:1777580309.455236:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573184 00000100:00100000:1.0:1777580309.455261:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573440 00000100:00100000:1.0:1777580309.455264:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573440 00000100:00100000:1.0:1777580309.455284:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11768 00000100:00100000:1.0:1777580309.455291:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946573184:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580309.455557:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2362:x1863919946573184:12345-192.168.202.9@tcp:2:touch.500 Request processed in 265us (1443us total) trans 8589938950 rc 0/0 00000100:00100000:1.0:1777580309.455564:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11768 00000100:00100000:1.0:1777580309.455577:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11769 00000100:00100000:1.0:1777580309.455583:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2364:x1863919946573440:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.455599:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.455613:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e063 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580309.455631:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15bd:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:1.0:1777580309.455644:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580309.455647:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580309.455654:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 33 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.455668:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 33 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.455679:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:1.0:1777580309.455693:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2364:x1863919946573440:12345-192.168.202.9@tcp:101:rm.500 Request processed in 110us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.455698:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11769 00010000:00010000:1.0:1777580309.471319:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471343:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471352:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471358:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.471364:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471382:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471404:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:1.0:1777580309.471407:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.471414:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.471420:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49779 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.471721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.471761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.471909:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573952 00000100:00100000:1.0:1777580309.471922:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573952 00000100:00100000:1.0:1777580309.471971:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830381369939 time 7830392776452 state 0x0 ref 1 00000100:00100000:1.0:1777580309.471987:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830392876452 time 7830392776452 state 0x1 ref 1 00000100:00100000:1.0:1777580309.472024:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830392876452 time 7830420886253 state 0x0 ref 1 00000100:00100000:1.0:1777580309.472040:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282926:x1863919946573952:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.472131:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.472193:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49844 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e047 expref: 394 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.472220:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e496d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfd0 expref: 393 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.472955:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946573696 00000100:00100000:3.0:1777580309.472964:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946573696 00010000:00010000:1.0:1777580309.474396:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024997a0a00) 00010000:00010000:1.0:1777580309.474427:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.474840:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.474870:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.474886:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.474906:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.474914:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.474921:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475069:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475078:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475078:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475086:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475087:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475094:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.475095:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475098:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475130:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475158:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02483f8e700) 00010000:00010000:0.0:1777580309.475161:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.475165:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.475171:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49875 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.475727:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1844, 64 off126208 00000004:00080000:1.0:1777580309.475741:0:187632:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7830424605637ns, next at 7831424602813ns, rc = 0 00010000:00010000:1.0:1777580309.475819:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475831:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475840:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475848:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475862:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.475869:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.476062:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4129 00000100:00100000:3.0:1777580309.476084:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:282920:x1863919946573696:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580309.476520:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282920:x1863919946573696:12345-192.168.202.9@tcp:35:touch.500 Request processed in 445us (4804us total) trans 8589950534 rc 0/0 00000100:00100000:3.0:1777580309.476530:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4129 00010000:00010000:1.0:1777580309.484628:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.484688:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484704:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484712:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484719:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.484724:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484734:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484764:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024acb37b00) 00010000:00010000:1.0:1777580309.484768:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.484868:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484876:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e498a6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484907:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484914:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484920:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484926:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.484929:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484936:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484944:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.484946:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.484949:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.484956:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49898 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.484976:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fe23a7a6 reply state 0000000074227814 transno 8589950533 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.484987:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.485115:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282926:x1863919946573952:12345-192.168.202.9@tcp:36:rm.500 Request processed in 13073us (13347us total) trans 8589950533 rc 0/0 00000100:00100000:1.0:1777580309.485127:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19245 00000100:00100000:1.0:1777580309.485159:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830392876452 time 7830420886253 state 0x2 ref 0 00010000:00010000:2.0:1777580309.485176:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580309.485186:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.485209:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580309.485213:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.485222:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.485234:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d2:0x0].0x0 (ffffa024acb37b00) 00010000:00010000:2.0:1777580309.485237:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580309.485241:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.485246:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e498ad lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.485268:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.485270:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.485273:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580309.485538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.485586:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574208 00000100:00100000:0.0:1777580309.485598:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574208 00000100:00100000:0.0:1777580309.485636:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830392876452 time 7830420886253 state 0x0 ref 1 00000100:00100000:0.0:1777580309.485651:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830420986253 time 7830420886253 state 0x1 ref 1 00000100:00100000:1.0:1777580309.485663:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.485675:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830420986253 time 7830434537761 state 0x0 ref 1 00000100:00100000:0.0:1777580309.485688:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282907:x1863919946574208:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:2.0:1777580309.485690:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574464 00000100:00100000:2.0:1777580309.485696:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574464 00000100:00100000:2.0:1777580309.485747:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4130 00010000:00010000:0.0:1777580309.485755:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1777580309.485760:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282902:x1863919946574464:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:0.0:1777580309.485781:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4949a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df13 expref: 160 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485804:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e492c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de9c expref: 159 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485814:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f9:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:0.0:1777580309.485828:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.485869:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485885:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485896:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485915:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485921:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.485928:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486064:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486072:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486080:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.486203:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282902:x1863919946574464:12345-192.168.202.9@tcp:35:touch.500 Request processed in 446us (539us total) trans 8589950535 rc 0/0 00000100:00100000:2.0:1777580309.486210:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4130 00000100:00100000:1.0:1777580309.486547:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000040:00080000:0.0:1777580309.486681:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1842, 64 off126080 00010000:00010000:0.0:1777580309.486739:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486750:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486766:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486774:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486781:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486787:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486816:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580309.486837:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486842:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486848:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486867:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.486871:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486878:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486888:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f9:0x0].0x0 (ffffa02488b85600) 00010000:00010000:0.0:1777580309.486891:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580309.486901:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486902:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580309.486907:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e498c2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486908:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486914:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.486917:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486923:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486928:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486931:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f9:0x0].0x0 (ffffa02488b85600) 00010000:00010000:1.0:1777580309.486933:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580309.486934:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486937:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486941:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486943:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e498c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486946:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.486949:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486954:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.486962:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.486962:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.486964:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.486964:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.486965:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.486967:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.486973:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e498b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.486982:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d517035d reply state 00000000e446a4e8 transno 8589950536 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.487002:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.489799:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574720 00000100:00100000:3.0:1777580309.489823:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574720 00000100:00100000:3.0:1777580309.489891:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830383017789 time 7830403854098 state 0x0 ref 1 00000100:00100000:3.0:1777580309.490030:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830403954098 time 7830403854098 state 0x1 ref 1 00000100:00100000:3.0:1777580309.490070:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830403954098 time 7830438931980 state 0x0 ref 1 00000100:00100000:3.0:1777580309.490091:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282922:x1863919946574720:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580309.490123:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.490170:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e498d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e06a expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.490263:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e498d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e06a expref: 396 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.490283:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6600/0xcb2b2f2f7e498d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e06a expref: 396 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.490307:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:3.0:1777580309.490310:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580309.490315:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6600, rc 0) 00000100:00100000:3.0:1777580309.503083:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:282922:x1863919946574720:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12983us (16518us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.503099:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19247 00000100:00100000:3.0:1777580309.503110:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830403954098 time 7830438931980 state 0x2 ref 0 00000100:00100000:0.0:1777580309.517737:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282907:x1863919946574208:12345-192.168.202.9@tcp:36:rm.500 Request processed in 32032us (32270us total) trans 8589950536 rc 0/0 00000100:00100000:0.0:1777580309.517754:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19246 00000100:00100000:0.0:1777580309.517766:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830420986253 time 7830434537761 state 0x2 ref 0 00000100:00100000:1.0:1777580309.524022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.524117:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524166:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524177:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524184:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.524191:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524200:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524221:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024acb37f00) 00010000:00010000:1.0:1777580309.524225:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.524231:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.524238:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4989f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.524339:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.524368:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574848 00000100:00100000:1.0:1777580309.524395:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574848 00000100:00100000:1.0:1777580309.524438:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830420986253 time 7830434537761 state 0x0 ref 1 00000100:00100000:1.0:1777580309.524846:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830434637761 time 7830434537761 state 0x1 ref 1 00000100:00100000:1.0:1777580309.524890:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830434637761 time 7830473752290 state 0x0 ref 1 00000100:00100000:1.0:1777580309.524908:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:282929:x1863919946574848:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.524940:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.524961:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e498d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e071 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525046:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525065:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525077:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525093:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525100:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525107:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525309:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525326:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525334:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.525368:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d3:0x0]: returning size 0 00000004:00200000:1.0:1777580309.525372:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580309.525397:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525411:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525420:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525427:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525433:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.525439:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.525443:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.525654:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574592 00000100:00100000:3.0:1777580309.525662:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574592 00010000:00010000:1.0:1777580309.526755:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526887:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.526907:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.526914:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526921:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e498de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526943:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526950:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526957:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526963:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.526967:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526974:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526982:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024acb37700) 00010000:00010000:1.0:1777580309.526984:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.526987:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.526993:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e498e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.527053:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e498d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e071 expref: 397 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.527080:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e071 expref: 396 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.527088:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090400) 00010000:00010000:1.0:1777580309.527091:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.527094:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:1.0:1777580309.527214:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:282929:x1863919946574848:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2309us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.527225:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19248 00000100:00100000:1.0:1777580309.527235:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830434637761 time 7830473752290 state 0x2 ref 0 00000100:00100000:1.0:1777580309.530654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.532077:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946574976 00000100:00100000:2.0:1777580309.532095:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946574976 00000100:00100000:2.0:1777580309.532193:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11770 00000100:00100000:2.0:1777580309.532221:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946574592:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580309.532374:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532388:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532398:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532404:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.532410:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532418:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532438:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02488b85b00) 00010000:00010000:0.0:1777580309.532442:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.532447:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.532454:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e498bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.532667:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.532691:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11771 00000100:00100000:3.0:1777580309.532708:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946574976:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:3.0:1777580309.532883:0:205898:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x15b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777580309.532887:0:205898:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x15b5:0x0] updating lvb mtime from disk: 1777580307 -> 1777580308 00002000:00010000:3.0:1777580309.532890:0:205898:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x240000400:0x15b5:0x0] updating lvb atime from disk: 1777580307 -> 1777580308 00002000:00010000:3.0:1777580309.532892:0:205898:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x15b5:0x0] updating lvb ctime from disk: 1777580307 -> 1777580308 00002000:00010000:3.0:1777580309.532894:0:205898:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x15b5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1777580309.533094:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946574592:12345-192.168.202.9@tcp:2:touch.500 Request processed in 876us (9087us total) trans 8589938551 rc 0/0 00000100:00100000:2.0:1777580309.533104:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11770 00000100:00100000:1.0:1777580309.537005:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946575232 00000100:00100000:1.0:1777580309.537028:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946575232 00000100:00100000:1.0:1777580309.537087:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830434637761 time 7830473752290 state 0x0 ref 1 00000100:00100000:1.0:1777580309.537104:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830473852290 time 7830473752290 state 0x1 ref 1 00000100:00100000:1.0:1777580309.537171:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830473852290 time 7830486032445 state 0x0 ref 1 00000100:00100000:1.0:1777580309.537190:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282910:x1863919946575232:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.538642:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.538693:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e494d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df36 expref: 159 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.538751:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49397 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ded4 expref: 158 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.538766:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fc:0x0].0x0 (ffffa02417834f00) 00010000:00010000:1.0:1777580309.539587:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.539629:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.539653:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.539666:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.539686:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.539695:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.539702:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542044:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542068:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542083:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.542747:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1845, 64 off126272 00010000:00010000:1.0:1777580309.542825:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542837:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542847:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542869:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542878:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542886:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542919:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.542949:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542956:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542964:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542971:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.542977:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.542992:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543007:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fc:0x0].0x0 (ffffa024acb37900) 00010000:00010000:1.0:1777580309.543010:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.543016:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543023:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49901 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543050:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543056:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543062:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543067:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.543069:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543075:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543083:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.543086:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.543088:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543104:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e498f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.543115:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a3551ede reply state 00000000d4b2f188 transno 8589950537 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.543126:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.543268:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282910:x1863919946575232:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6080us (10596us total) trans 8589950537 rc 0/0 00000100:00100000:1.0:1777580309.543279:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19249 00000100:00100000:1.0:1777580309.543289:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830473852290 time 7830486032445 state 0x2 ref 0 00010000:00010000:1.0:1777580309.543346:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.543352:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543358:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.543362:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543367:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543376:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fc:0x0].0x0 (ffffa024acb37900) 00010000:00010000:1.0:1777580309.543378:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.543381:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543386:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49908 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.543415:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.543417:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.543420:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580309.545688:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2361:x1863919946574976:12345-192.168.202.9@tcp:2:touch.500 Request processed in 12964us (15030us total) trans 8589938951 rc 0/0 00000100:00100000:3.0:1777580309.545718:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11771 00000100:00100000:2.0:1777580309.546542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.547048:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946575616 00000100:00100000:1.0:1777580309.547060:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.547061:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946575616 00000100:00100000:3.0:1777580309.547121:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4131 00010000:00010000:1.0:1777580309.547123:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.547131:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:282925:x1863919946575616:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580309.547157:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.547166:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.547172:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.547177:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.547185:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.547204:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024acb37800) 00010000:00010000:1.0:1777580309.547207:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.547212:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.547218:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e498fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.547298:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946575360 00000100:00100000:2.0:1777580309.547304:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946575360 00000100:00100000:2.0:1777580309.547346:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11772 00000100:00100000:2.0:1777580309.547355:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946575360:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580309.547369:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.547948:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e078 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580309.547986:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1599:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:2.0:1777580309.548092:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.548095:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580309.548106:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.548128:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.548177:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b000, rc 0) 00000100:00100000:2.0:1777580309.548259:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2362:x1863919946575360:12345-192.168.202.9@tcp:101:rm.500 Request processed in 905us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.548268:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11772 00000100:00100000:3.0:1777580309.548851:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:282925:x1863919946575616:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1718us (2310us total) trans 8589950538 rc 0/0 00000100:00100000:3.0:1777580309.548869:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4131 00000100:00100000:3.0:1777580309.552403:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.552443:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946575872 00000100:00100000:2.0:1777580309.552457:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946575872 00000100:00100000:2.0:1777580309.552530:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4132 00000100:00100000:2.0:1777580309.552541:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:282922:x1863919946575872:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580309.554316:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:282922:x1863919946575872:12345-192.168.202.9@tcp:35:touch.500 Request processed in 950us (1101us total) trans 8589950539 rc 0/0 00000100:00100000:2.0:1777580309.554335:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4132 00000100:00100000:3.0:1777580309.558075:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.558491:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946576128 00000100:00100000:0.0:1777580309.558517:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946576128 00000100:00100000:0.0:1777580309.558574:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830473852290 time 7830486032445 state 0x0 ref 1 00000100:00100000:0.0:1777580309.558591:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830486132445 time 7830486032445 state 0x1 ref 1 00000100:00100000:0.0:1777580309.558620:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830486132445 time 7830507482436 state 0x0 ref 1 00000100:00100000:0.0:1777580309.558634:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:282901:x1863919946576128:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580309.558712:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580309.558748:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e49462 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df05 expref: 158 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558778:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e491bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de48 expref: 157 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558794:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f6:0x0].0x0 (ffffa02481358800) 00010000:00010000:0.0:1777580309.558806:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.558837:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558864:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558877:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558894:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558913:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.558920:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559079:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559088:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559096:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580309.559739:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1846, 64 off126336 00010000:00010000:0.0:1777580309.559819:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559832:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559841:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559849:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559867:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559874:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559906:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580309.559932:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559939:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559944:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559951:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.559955:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559963:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559975:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f6:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:0.0:1777580309.559979:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580309.559982:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.559988:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49924 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560009:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560015:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560031:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560036:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.560039:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560044:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560051:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.560053:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.560055:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560060:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49916 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.560069:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002ce582af reply state 00000000913cc2c0 transno 8589950540 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.560078:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.560223:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:282901:x1863919946576128:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1587us (2158us total) trans 8589950540 rc 0/0 00000100:00100000:0.0:1777580309.560234:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19250 00000100:00100000:0.0:1777580309.560242:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830486132445 time 7830507482436 state 0x2 ref 0 00010000:00010000:0.0:1777580309.560434:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580309.560442:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560459:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580309.560463:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560470:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560480:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f6:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:0.0:1777580309.560482:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580309.560485:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560491:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4992b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.560508:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.560510:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.560512:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580309.567771:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.567828:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946576384 00000100:00100000:0.0:1777580309.567842:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946576384 00000100:00100000:0.0:1777580309.567906:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830486132445 time 7830507482436 state 0x0 ref 1 00000100:00100000:0.0:1777580309.567922:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830507582436 time 7830507482436 state 0x1 ref 1 00000100:00100000:0.0:1777580309.567953:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830507582436 time 7830516814560 state 0x0 ref 1 00000100:00100000:0.0:1777580309.567965:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:282929:x1863919946576384:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580309.568040:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580309.568088:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e498ec lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e071 expref: 398 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568114:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49787 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e016 expref: 397 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568126:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02486090400) 00010000:00010000:0.0:1777580309.568167:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.568204:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568224:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568236:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568256:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568263:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568270:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568429:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568438:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.568457:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580309.572755:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1843, 64 off126144 00010000:00010000:0.0:1777580309.572899:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572923:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572937:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572947:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572954:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572961:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.572994:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580309.573024:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573030:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573036:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573054:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.573059:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573067:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573080:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02488b85300) 00010000:00010000:0.0:1777580309.573083:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580309.573089:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573095:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49940 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573124:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573130:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573156:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573160:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.573163:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573169:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573187:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.573189:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.573192:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.573198:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49932 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.573209:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000080bda513 reply state 0000000019c488a2 transno 8589950541 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.573219:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580309.574646:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580309.574662:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.574673:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580309.574677:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.574686:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.574703:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d3:0x0].0x0 (ffffa02488b85300) 00010000:00010000:3.0:1777580309.574706:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580309.574709:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.574716:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49947 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.574768:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580309.574770:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580309.574772:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580309.575530:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:282929:x1863919946576384:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7556us (7763us total) trans 8589950541 rc 0/0 00000100:00100000:0.0:1777580309.575544:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19251 00000100:00100000:0.0:1777580309.575555:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830507582436 time 7830516814560 state 0x2 ref 0 00010000:00010000:0.0:1777580309.575625:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575636:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575643:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575648:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea3800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.575653:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575674:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575687:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02488b85b00) 00010000:00010000:0.0:1777580309.575690:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.575694:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.575701:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e4991d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.585784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.586406:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946576640 00000100:00100000:1.0:1777580309.586421:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946576640 00000100:00100000:1.0:1777580309.586579:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830507582436 time 7830516814560 state 0x0 ref 1 00000100:00100000:1.0:1777580309.586595:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830516914560 time 7830516814560 state 0x1 ref 1 00000100:00100000:1.0:1777580309.586629:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830516914560 time 7830535491373 state 0x0 ref 1 00000100:00100000:1.0:1777580309.586645:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:282908:x1863919946576640:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.586732:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.586767:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4947e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df28 expref: 157 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588425:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49327 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90deb1 expref: 156 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588873:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fa:0x0].0x0 (ffffa02499479000) 00010000:00010000:1.0:1777580309.588892:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.588927:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588946:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588958:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588978:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.588984:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.589004:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.589182:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.589190:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.589197:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591610:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591630:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591638:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591644:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.591650:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591658:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591675:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02488b85000) 00010000:00010000:0.0:1777580309.591679:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.591700:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.591707:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49939 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.593403:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1847, 64 off126400 00010000:00010000:1.0:1777580309.597303:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597337:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597354:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597365:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597373:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597381:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597410:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.597457:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597465:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597473:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597480:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.597487:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597497:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597513:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fa:0x0].0x0 (ffffa024acb37900) 00010000:00010000:1.0:1777580309.597518:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.597525:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597533:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4995c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597565:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597572:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597580:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597597:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.597601:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597609:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597621:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.597624:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.597627:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.597633:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4994e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.597646:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b544b9ec reply state 00000000c1afcc2f transno 8589950542 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.597657:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.597793:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:282908:x1863919946576640:12345-192.168.202.9@tcp:36:rm.500 Request processed in 11146us (12018us total) trans 8589950542 rc 0/0 00000100:00100000:1.0:1777580309.597808:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19252 00000100:00100000:1.0:1777580309.597819:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830516914560 time 7830535491373 state 0x2 ref 0 00000100:00100000:0.0:1777580309.598131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.599129:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946576896 00000100:00100000:1.0:1777580309.599159:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946576896 00000100:00100000:1.0:1777580309.599207:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830403954098 time 7830438931980 state 0x0 ref 1 00010000:00010000:0.0:1777580309.599213:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1777580309.599224:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830439031980 time 7830438931980 state 0x1 ref 1 00010000:00010000:0.0:1777580309.599225:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.599236:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580309.599242:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.599252:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.599272:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fa:0x0].0x0 (ffffa024acb37900) 00010000:00010000:0.0:1777580309.599275:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580309.599280:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.599285:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830439031980 time 7830548147013 state 0x0 ref 1 00010000:00010000:0.0:1777580309.599288:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49963 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.599303:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:282936:x1863919946576896:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.599317:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.599321:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.599324:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.599338:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.599358:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4996a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e07f expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599567:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599582:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599593:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599608:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599615:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599621:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599685:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e4997f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599694:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e4997f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599711:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e4997f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.599721:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7f7:0x0]: returning size 0 00010000:00010000:1.0:1777580309.599839:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599847:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599861:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599866:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.599872:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599878:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599888:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.599891:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.599895:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599901:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49971 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599913:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599928:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599933:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599938:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.599941:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599946:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599953:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024acb37700) 00010000:00010000:1.0:1777580309.599955:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.599958:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.599962:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49978 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.600010:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4996a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e07f expref: 400 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.600025:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e4997f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e07f expref: 399 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.600032:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.600034:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.600041:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a600, rc 0) 00000100:00100000:1.0:1777580309.600113:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:282936:x1863919946576896:12345-192.168.202.9@tcp:101:touch.500 Request processed in 816us (1986us total) trans 8589950543 rc 0/0 00000100:00100000:1.0:1777580309.600122:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19253 00000100:00100000:1.0:1777580309.600128:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830439031980 time 7830548147013 state 0x2 ref 0 00010000:00010000:0.0:1777580309.611378:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611403:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611422:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611429:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.611593:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611605:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611631:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa024acb37800) 00010000:00010000:0.0:1777580309.611635:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.611641:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.611649:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49955 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.614538:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.614593:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946577152 00000100:00100000:1.0:1777580309.614605:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946577152 00000100:00100000:1.0:1777580309.614656:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830439031980 time 7830548147013 state 0x0 ref 1 00000100:00100000:1.0:1777580309.614673:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830548247013 time 7830548147013 state 0x1 ref 1 00000100:00100000:1.0:1777580309.614704:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830548247013 time 7830563565620 state 0x0 ref 1 00000100:00100000:1.0:1777580309.614717:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:282936:x1863919946577152:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.614805:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.614844:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e4997f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e07f expref: 399 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.614882:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.614888:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.614991:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.615011:0:205909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 155 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.615020:0:205909:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.615073:0:205909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 155 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.615090:0:205909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 155 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.615109:0:205909:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388924700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205909:1863919917458560:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580309.615236:0:205909:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42840 going to sleep for 11 seconds 00000100:00100000:3.0:1777580309.617072:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.618368:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.618764:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946577408 00000100:00100000:0.0:1777580309.618778:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946577408 00000100:00100000:0.0:1777580309.618846:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830563665620 time 7830563565620 state 0x1 ref 2 00000100:00100000:0.0:1777580309.618884:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946577536 00000100:00100000:0.0:1777580309.618888:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946577536 00000100:00100000:0.0:1777580309.618903:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830516914560 time 7830535491373 state 0x0 ref 1 00000100:00100000:0.0:1777580309.618912:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830535591373 time 7830535491373 state 0x1 ref 1 00000100:00100000:0.0:1777580309.618937:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830535591373 time 7830567798586 state 0x0 ref 1 00000100:00100000:0.0:1777580309.618954:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282892:x1863919946577536:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580309.618998:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.619029:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49994 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e08d expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619117:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619167:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619186:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619207:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619217:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619225:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619400:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619411:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.619420:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.619531:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830563665620 time 7830568391527 state 0x0 ref 2 00000100:00100000:1.0:1777580309.619551:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:282933:x1863919946577408:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.619562:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.619573:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e499b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e086 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619663:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619673:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619683:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619697:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619705:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.619722:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580309.622866:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15bf:0x0], index 0: 0 00010000:00010000:1.0:1777580309.623172:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e499c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623194:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e499c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623207:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e499c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623408:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623418:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623425:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623434:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.623440:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623449:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623465:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.623469:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.623482:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623490:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e499b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.623507:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000093ecefb reply state 00000000296a7630 transno 8589950544 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.623518:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580309.623561:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e499b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e086 expref: 402 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623578:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e499c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e086 expref: 401 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.623586:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024acb37e00) 00010000:00010000:1.0:1777580309.623588:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.623591:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000004:00200000:0.0:1777580309.625016:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7f4:0x0]: returning size 0 00000004:00200000:0.0:1777580309.625045:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580309.625086:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.625102:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:282933:x1863919946577408:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5552us (8036us total) trans 8589950544 rc 0/0 00010000:00010000:0.0:1777580309.625108:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.625113:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19255 00010000:00010000:0.0:1777580309.625120:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625127:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625146:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625152:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.625157:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625164:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625177:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.625180:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.625184:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625189:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4999b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625206:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625222:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625227:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625231:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.625234:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625240:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625248:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02488b85000) 00010000:00010000:0.0:1777580309.625251:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.625254:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625260:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e499a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625306:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49994 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e08d expref: 158 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625322:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e08d expref: 157 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.625330:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:0.0:1777580309.625332:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.625341:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:0.0:1777580309.635070:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:282892:x1863919946577536:12345-192.168.202.9@tcp:101:rm.500 Request processed in 16104us (16693us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580309.635086:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19256 00000100:00100000:0.0:1777580309.635097:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830535591373 time 7830567798586 state 0x2 ref 0 00000100:00100000:1.0:1777580309.636565:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.636796:0:205909:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388924700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205909:1863919917458560:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580309.636832:0:205909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.638195:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946577664 00000100:00100000:2.0:1777580309.638212:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946577664 00010000:00010000:2.0:1777580309.638269:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 157 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.638321:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4331 00000100:00100000:2.0:1777580309.638334:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:2361:x1863919946577664:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580309.638356:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580309.638363:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 157 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638379:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 157 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638407:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4953b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df1a expref: 157 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638432:0:187616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:2.0:1777580309.638439:0:187616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638463:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638473:0:187616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.638740:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580309.638829:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:2361:x1863919946577664:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 498us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.638839:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4331 00000100:00100000:3.0:1777580309.647896:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.647962:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946577920 00000100:00100000:1.0:1777580309.647975:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946577920 00000100:00100000:1.0:1777580309.648027:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830535591373 time 7830567798586 state 0x0 ref 1 00000100:00100000:1.0:1777580309.648050:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830567898586 time 7830567798586 state 0x1 ref 1 00000100:00100000:1.0:1777580309.648087:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830567898586 time 7830596948921 state 0x0 ref 1 00000100:00100000:1.0:1777580309.648102:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282892:x1863919946577920:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.648198:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.648231:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e499a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e08d expref: 156 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648258:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e49159 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de2c expref: 155 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648273:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:1.0:1777580309.648280:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.648315:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648333:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648347:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648366:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648375:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648384:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648562:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648574:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.648583:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.649325:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1848, 64 off126464 00010000:00010000:1.0:1777580309.649438:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649452:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649464:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649474:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649482:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649491:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649518:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.649545:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649562:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649570:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649578:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.649585:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649594:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649609:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:1.0:1777580309.649612:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.649618:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649625:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e499e1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649647:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649654:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649660:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649666:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.649673:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649680:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649689:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.649692:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.649696:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649703:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e499d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.649717:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aa24bdfc reply state 000000001ef2032b transno 8589950545 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.649727:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.649842:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282892:x1863919946577920:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1739us (1954us total) trans 8589950545 rc 0/0 00000100:00100000:1.0:1777580309.649867:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19257 00000100:00100000:1.0:1777580309.649877:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830567898586 time 7830596948921 state 0x2 ref 0 00010000:00010000:1.0:1777580309.649933:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.649941:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649949:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.649954:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649962:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649980:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f4:0x0].0x0 (ffffa024997a0900) 00010000:00010000:1.0:1777580309.649984:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.649988:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.649995:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e499e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.650009:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.650013:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.650017:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580309.650744:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650759:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650765:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650771:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.650775:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650782:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650794:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024acb37f00) 00010000:00010000:0.0:1777580309.650796:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.650800:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650805:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e499be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650888:0:205909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.650907:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.651073:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021cfadcf reply state 0000000086aef3b1 transno 8589950546 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.651083:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.651236:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:282936:x1863919946577152:12345-192.168.202.9@tcp:36:touch.500 Request processed in 36518us (36709us total) trans 8589950546 rc 0/0 00000100:00100000:0.0:1777580309.651247:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19254 00000100:00100000:0.0:1777580309.651254:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830563665620 time 7830568391527 state 0x2 ref 0 00000100:00100000:1.0:1777580309.655475:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.655619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.655656:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.655697:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578176 00000100:00100000:1.0:1777580309.655710:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578176 00000100:00100000:1.0:1777580309.655760:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830563665620 time 7830568391527 state 0x0 ref 1 00000100:00100000:1.0:1777580309.655777:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830568491527 time 7830568391527 state 0x1 ref 1 00000100:00100000:1.0:1777580309.655801:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578304 00000100:00100000:1.0:1777580309.655804:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578304 00000100:00100000:1.0:1777580309.655821:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830567898586 time 7830596948921 state 0x0 ref 1 00000100:00100000:1.0:1777580309.655829:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830597048921 time 7830596948921 state 0x1 ref 1 00000100:00100000:1.0:1777580309.655850:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578432 00000100:00100000:3.0:1777580309.656652:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830568491527 time 7830605509447 state 0x0 ref 1 00000100:00100000:3.0:1777580309.656680:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:282933:x1863919946578176:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580309.656756:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580309.656793:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e499c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e086 expref: 403 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.656819:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024acb37e00) 00010000:00010000:3.0:1777580309.656848:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580309.656957:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.656972:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.656983:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.657180:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005324da46 reply state 000000006303d09e transno 8589950547 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.657191:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.657337:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282933:x1863919946578176:12345-192.168.202.9@tcp:36:touch.500 Request processed in 668us (1874us total) trans 8589950547 rc 0/0 00000100:00100000:3.0:1777580309.657346:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19258 00000100:00100000:3.0:1777580309.657353:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830568491527 time 7830605509447 state 0x2 ref 0 00000100:00100000:3.0:1777580309.657386:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830597048921 time 7830606249231 state 0x0 ref 1 00000100:00100000:3.0:1777580309.657397:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:282935:x1863919946578304:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.657409:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.657421:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e499f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e094 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657492:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657504:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657513:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657528:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657536:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657543:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657669:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657686:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657694:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580309.657722:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d5:0x0]: returning size 0 00000004:00200000:3.0:1777580309.657726:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580309.657743:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657756:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657765:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657772:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657780:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657787:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.657792:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657801:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657812:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.657821:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.657826:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657833:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e499fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657847:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657867:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657874:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657880:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.657883:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657890:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657899:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024185aa000) 00010000:00010000:3.0:1777580309.657901:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.657904:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657911:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657942:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e499f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e094 expref: 405 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657965:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e094 expref: 404 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.657973:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024acb37500) 00010000:00010000:3.0:1777580309.657976:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.657979:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149a00, rc 0) 00000100:00100000:3.0:1777580309.658012:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282935:x1863919946578304:12345-192.168.202.9@tcp:101:rm.500 Request processed in 615us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.658020:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19259 00000100:00100000:3.0:1777580309.658025:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830597048921 time 7830606249231 state 0x2 ref 0 00000100:00100000:1.0:1777580309.659171:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578432 00000100:00100000:1.0:1777580309.659220:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830597048921 time 7830606249231 state 0x0 ref 1 00000100:00100000:1.0:1777580309.659565:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830606349231 time 7830606249231 state 0x1 ref 1 00000100:00100000:1.0:1777580309.659611:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830606349231 time 7830608473512 state 0x0 ref 1 00000100:00100000:1.0:1777580309.659629:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282937:x1863919946578432:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.659652:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.659675:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49a12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e09b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659767:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659784:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659798:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659811:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659821:0:207396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659829:0:207396:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659850:0:207396:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.659886:0:207396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672615:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672640:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672649:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672657:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.672664:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672674:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672699:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024185aa300) 00010000:00010000:0.0:1777580309.672703:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.672720:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672728:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e499ef lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672770:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672777:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672785:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672791:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.672795:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672802:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672813:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024acb37700) 00010000:00010000:0.0:1777580309.672817:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.672833:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672845:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672862:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672912:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672919:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e499da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672941:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672947:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672953:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672958:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.672960:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672965:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672973:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:0.0:1777580309.672976:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.672978:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.672984:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4998d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673729:0:207396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673742:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673879:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673887:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673893:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673899:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.673902:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673918:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673931:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.673934:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.673938:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673944:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49a19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673956:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673961:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673966:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673971:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.673973:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673978:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.673984:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024acb37700) 00010000:00010000:3.0:1777580309.673986:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.673989:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.674001:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49a20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.674064:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49a12 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e09b expref: 403 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.674077:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.674079:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.674083:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49a12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e09b expref: 403 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.674092:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:3.0:1777580309.674227:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:282937:x1863919946578432:12345-192.168.202.9@tcp:101:rm.500 Request processed in 14602us (18568us total) trans 0 rc 301/301 00000100:00100000:3.0:1777580309.674238:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19260 00000100:00100000:3.0:1777580309.674248:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830606349231 time 7830608473512 state 0x2 ref 0 00000100:00100000:0.0:1777580309.674431:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.676722:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578688 00000100:00100000:3.0:1777580309.676744:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578688 00000100:00100000:3.0:1777580309.676805:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830606349231 time 7830608473512 state 0x0 ref 1 00000100:00100000:3.0:1777580309.676839:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830608573512 time 7830608473512 state 0x1 ref 1 00000100:00100000:3.0:1777580309.676891:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830608573512 time 7830625752624 state 0x0 ref 1 00000100:00100000:3.0:1777580309.676909:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282904:x1863919946578688:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580309.677017:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580309.677057:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4957a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df44 expref: 155 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677086:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4924e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de72 expref: 154 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677099:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f8:0x0].0x0 (ffffa02493ac1000) 00010000:00010000:3.0:1777580309.677111:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580309.677166:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677183:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677195:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677212:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677218:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677224:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677382:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677392:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.677411:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.682510:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.682570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.682615:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.682659:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578816 00000100:00100000:1.0:1777580309.682671:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578816 00000100:00100000:1.0:1777580309.682720:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830568491527 time 7830605509447 state 0x0 ref 1 00000100:00100000:1.0:1777580309.682736:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830605609447 time 7830605509447 state 0x1 ref 1 00000100:00100000:1.0:1777580309.682765:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946578944 00000100:00100000:1.0:1777580309.682768:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946578944 00000100:00100000:1.0:1777580309.682784:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830605609447 time 7830605509447 state 0x1 ref 2 00000100:00100000:1.0:1777580309.682809:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830631770966 time 7830631670966 state 0x1 ref 2 00000100:00100000:1.0:1777580309.682823:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:282936:x1863919946578816:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.682867:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.682895:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e49a3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0a2 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.682970:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e49a3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0a2 expref: 404 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.682988:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a600/0xcb2b2f2f7e49a3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0a2 expref: 404 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.683029:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.683032:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.683038:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a600, rc 0) 00000100:00100000:1.0:1777580309.683105:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282936:x1863919946578816:12345-192.168.202.9@tcp:101:touch.500 Request processed in 285us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.683114:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19262 00000100:00100000:1.0:1777580309.683167:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830631770966 time 7830632029478 state 0x0 ref 1 00000100:00100000:1.0:1777580309.683177:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:282933:x1863919946578944:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.683187:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.683201:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49a43 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0a9 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.683231:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49a43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0a9 expref: 404 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.683241:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49a43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0a9 expref: 404 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.683252:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024acb37100) 00010000:00010000:1.0:1777580309.683254:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.683257:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:1.0:1777580309.683278:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282933:x1863919946578944:12345-192.168.202.9@tcp:101:touch.500 Request processed in 102us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.683284:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19263 00000100:00100000:1.0:1777580309.683294:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830631770966 time 7830632029478 state 0x2 ref 0 00000040:00080000:3.0:1777580309.688323:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1849, 64 off126528 00000100:00100000:1.0:1777580309.689080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.689129:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579200 00000100:00100000:1.0:1777580309.689155:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579200 00000100:00100000:1.0:1777580309.689209:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830625852624 time 7830625752624 state 0x1 ref 2 00000100:00100000:1.0:1777580309.689243:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830625852624 time 7830638104751 state 0x0 ref 2 00000100:00100000:1.0:1777580309.689256:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282937:x1863919946579200:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.689295:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.689323:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49a4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0b7 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689411:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689432:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689446:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689465:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689472:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689479:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689573:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689582:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689590:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689597:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.689602:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689611:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689623:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.689626:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.689631:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689637:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49a51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689652:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689657:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689662:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689674:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.689677:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689683:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689690:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024acb37200) 00010000:00010000:1.0:1777580309.689692:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.689694:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689700:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49a58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689736:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49a4a lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b7 expref: 405 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689746:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.689748:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.689751:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49a4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b7 expref: 405 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.689760:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:1.0:1777580309.689832:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282937:x1863919946579200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 578us (760us total) trans 0 rc 301/301 00000100:00100000:1.0:1777580309.689841:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19264 00000100:00100000:1.0:1777580309.690493:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579072 00000100:00100000:1.0:1777580309.690511:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579072 00000100:00100000:1.0:1777580309.690562:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11773 00000100:00100000:1.0:1777580309.690571:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946579072:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580309.690586:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.690609:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0b0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580309.690639:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159a:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:1.0:1777580309.690663:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580309.690666:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580309.690676:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 29 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.690693:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 29 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.690706:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ae00, rc 0) 00000100:00100000:1.0:1777580309.690754:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946579072:12345-192.168.202.9@tcp:101:rm.500 Request processed in 183us (8139us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.690763:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11773 00010000:00010000:3.0:1777580309.692839:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692883:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692901:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692912:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692921:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692929:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.692973:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580309.693008:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693016:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693023:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693051:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.693057:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693065:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693084:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f8:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:3.0:1777580309.693088:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580309.693095:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693102:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a35 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693154:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693162:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693169:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693175:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.693179:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693187:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693211:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.693215:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.693219:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.693226:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49a27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.693242:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002348ae5e reply state 00000000ba8d466f transno 8589950548 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.693252:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.693376:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282904:x1863919946578688:12345-192.168.202.9@tcp:36:rm.500 Request processed in 16467us (18940us total) trans 8589950548 rc 0/0 00000100:00100000:3.0:1777580309.693388:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19261 00000100:00100000:3.0:1777580309.693399:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830625852624 time 7830638104751 state 0x2 ref 0 00010000:00010000:1.0:1777580309.695213:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.695229:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.695241:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.695246:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.695279:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.695297:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f8:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580309.695300:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.695305:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.695311:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a66 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.695345:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.695348:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.695350:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580309.696282:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.696313:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.696342:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579328 00000100:00100000:3.0:1777580309.696352:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579328 00000100:00100000:3.0:1777580309.696402:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579456 00000100:00100000:3.0:1777580309.696404:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579456 00000100:00100000:3.0:1777580309.696424:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11774 00000100:00100000:3.0:1777580309.696433:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2362:x1863919946579328:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:3.0:1777580309.696707:0:205907:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x1592:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777580309.696712:0:205907:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x1592:0x0] updating lvb mtime from disk: 1777580308 -> 1777580308 00002000:00010000:3.0:1777580309.696715:0:205907:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x1592:0x0] updating lvb atime from disk: 1777580308 -> 1777580308 00002000:00010000:3.0:1777580309.696728:0:205907:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x1592:0x0] updating lvb ctime from disk: 1777580308 -> 1777580308 00002000:00010000:3.0:1777580309.696730:0:205907:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x1592:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1777580309.696797:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946579328:12345-192.168.202.9@tcp:2:touch.500 Request processed in 364us (524us total) trans 8589938552 rc 0/0 00000100:00100000:3.0:1777580309.696808:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11774 00000100:00100000:3.0:1777580309.696836:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11775 00000100:00100000:3.0:1777580309.696865:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2362:x1863919946579456:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580309.697104:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2362:x1863919946579456:12345-192.168.202.9@tcp:2:touch.500 Request processed in 260us (788us total) trans 8589938952 rc 0/0 00000100:00100000:3.0:1777580309.697112:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11775 00010000:00010000:0.0:1777580309.705277:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705301:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705312:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705320:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.705327:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705337:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705363:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024185aa000) 00010000:00010000:0.0:1777580309.705368:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.705374:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.705383:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49a2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.717489:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.717570:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579712 00000100:00100000:0.0:1777580309.717586:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579712 00000100:00100000:3.0:1777580309.717590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.717640:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830631770966 time 7830632029478 state 0x0 ref 1 00000100:00100000:0.0:1777580309.717656:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830632129478 time 7830632029478 state 0x1 ref 1 00000100:00100000:0.0:1777580309.717680:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946579840 00000100:00100000:0.0:1777580309.717683:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946579840 00000100:00100000:0.0:1777580309.717713:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830625852624 time 7830638104751 state 0x0 ref 1 00000100:00100000:0.0:1777580309.717720:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830638204751 time 7830638104751 state 0x1 ref 1 00000100:00100000:0.0:1777580309.717738:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830632129478 time 7830666599927 state 0x0 ref 1 00000100:00100000:0.0:1777580309.717751:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:282943:x1863919946579712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.717779:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.717807:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49a6d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0be expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718036:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718055:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718069:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718086:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718093:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.718099:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580309.719347:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159b:0x0], index 1: 0 00010000:00010000:0.0:1777580309.719790:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719819:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719831:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719892:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719900:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719908:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719915:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.719920:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719929:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719943:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.719947:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.719953:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.719959:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49a74 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.719980:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002ec3549f reply state 00000000cda31349 transno 8589950549 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.719997:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.720043:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49a6d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0be expref: 407 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.720061:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0be expref: 406 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.720070:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02488b85b00) 00010000:00010000:0.0:1777580309.720073:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.720077:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6ec00, rc 0) 00000100:00100000:3.0:1777580309.721973:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830638204751 time 7830670823924 state 0x0 ref 1 00000100:00100000:3.0:1777580309.722018:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282905:x1863919946579840:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.722055:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.722084:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0c5 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722349:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722369:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722384:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722424:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722451:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722460:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722621:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722631:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722638:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580309.722675:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x7f7:0x0]: returning size 0 00000004:00200000:3.0:1777580309.722680:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580309.722705:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722718:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722728:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722735:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722752:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722760:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.722765:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722773:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722786:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.722790:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.722795:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722802:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49a97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722816:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722822:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722829:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722834:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.722836:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722851:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722874:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185aa000) 00010000:00010000:3.0:1777580309.722877:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.722880:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722887:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49a9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722926:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49a90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0c5 expref: 156 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722942:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0c5 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.722949:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:3.0:1777580309.722952:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.722955:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6800, rc 0) 00000100:00100000:0.0:1777580309.723688:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:282943:x1863919946579712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5932us (6206us total) trans 8589950549 rc 0/0 00000100:00100000:0.0:1777580309.723702:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19265 00000100:00100000:0.0:1777580309.723711:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830632129478 time 7830666599927 state 0x2 ref 0 00000100:00100000:3.0:1777580309.724690:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282905:x1863919946579840:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2687us (7094us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.724702:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19266 00000100:00100000:3.0:1777580309.724708:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830638204751 time 7830670823924 state 0x2 ref 0 00000100:00100000:2.0:1777580309.724916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.725033:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.725318:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946580096 00000100:00100000:0.0:1777580309.725330:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946580096 00000100:00100000:0.0:1777580309.725389:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946580352 00000100:00100000:0.0:1777580309.725393:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946580352 00000100:00100000:0.0:1777580309.725408:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4133 00000100:00100000:0.0:1777580309.725416:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+408:282933:x1863919946580096:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580309.725510:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4134 00000100:00100000:2.0:1777580309.725521:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+408:282936:x1863919946580352:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580309.727626:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+410:282936:x1863919946580352:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2090us (2576us total) trans 8589950550 rc 0/0 00000100:00100000:2.0:1777580309.727640:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4134 00000100:00100000:0.0:1777580309.731423:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+409:282933:x1863919946580096:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5991us (6495us total) trans 8589950551 rc 0/0 00000100:00100000:0.0:1777580309.731460:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4133 00010000:00010000:1.0:1777580309.739441:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739464:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739473:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739480:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.739486:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739495:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739515:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02488b85000) 00010000:00010000:1.0:1777580309.739527:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.739533:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.739541:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49a7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.741101:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.741171:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.741196:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.741231:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946580736 00000100:00100000:1.0:1777580309.741255:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946580736 00000100:00100000:1.0:1777580309.741303:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830632129478 time 7830666599927 state 0x0 ref 1 00000100:00100000:2.0:1777580309.741306:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946580864 00000100:00100000:2.0:1777580309.741314:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946580864 00000100:00100000:1.0:1777580309.741321:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830666699927 time 7830666599927 state 0x1 ref 1 00000100:00100000:2.0:1777580309.741344:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830638204751 time 7830670823924 state 0x0 ref 1 00000100:00100000:1.0:1777580309.741344:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946581120 00000100:00100000:1.0:1777580309.741349:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946581120 00000100:00100000:2.0:1777580309.741358:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830670923924 time 7830670823924 state 0x1 ref 1 00000100:00100000:1.0:1777580309.741367:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830666699927 time 7830666599927 state 0x1 ref 2 00000100:00100000:2.0:1777580309.741392:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690352846 time 7830690252846 state 0x1 ref 2 00000100:00100000:2.0:1777580309.741408:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+409:282943:x1863919946580736:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580309.741496:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777580309.741615:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830670923924 time 7830690476360 state 0x0 ref 1 00000100:00100000:1.0:1777580309.741627:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282905:x1863919946580864:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.741657:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.741685:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49aa5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0c5 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741713:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4922b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de6b expref: 154 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741745:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.741751:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.741784:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741802:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741814:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741920:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741930:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.741938:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.742094:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.742103:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.742111:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.742928:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0be expref: 409 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.742953:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02488b85b00) 00010000:00010000:2.0:1777580309.742965:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580309.743052:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.743063:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.743072:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.743488:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000712c705 reply state 000000006bdc4ee5 transno 8589950552 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.743500:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580309.744271:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+410:282943:x1863919946580736:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2862us (3178us total) trans 8589950552 rc 0/0 00000100:00100000:2.0:1777580309.744281:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19267 00000100:00100000:2.0:1777580309.744330:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690352846 time 7830693190964 state 0x0 ref 1 00000100:00100000:2.0:1777580309.744346:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+409:282945:x1863919946581120:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.744367:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.744386:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49ac8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0cc expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744504:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744527:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744538:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744555:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744561:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.744567:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.745085:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1844, 64 off126208 00010000:00010000:1.0:1777580309.745177:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.745196:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.745206:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.745215:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.745222:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.745229:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746424:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.746468:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746479:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746486:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746492:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.746497:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746505:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746544:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.746547:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.746553:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746560:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49aba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746587:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746593:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746599:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746604:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.746607:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746613:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746620:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.746622:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.746625:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.746631:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49aac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.746651:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000028b7ed8d reply state 0000000072be9891 transno 8589950553 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.746661:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.746770:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282905:x1863919946580864:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5140us (5592us total) trans 8589950553 rc 0/0 00000100:00100000:1.0:1777580309.746782:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19268 00000100:00100000:1.0:1777580309.746791:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830670923924 time 7830690476360 state 0x2 ref 0 00000004:00080000:2.0:1777580309.748439:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c0:0x0], index 0: 0 00010000:00010000:1.0:1777580309.748613:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.748625:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.748637:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.748642:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.748651:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.748668:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7f7:0x0].0x0 (ffffa02417834700) 00010000:00010000:1.0:1777580309.748671:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.748675:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.748681:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49add lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.748696:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.748698:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.748709:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.749289:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49ae4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749308:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749322:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749382:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749389:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749395:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749410:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.749414:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749422:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749432:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.749435:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.749439:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749445:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49acf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.749459:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000003997061 reply state 0000000095b6d6bc transno 8589950554 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.749468:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580309.749517:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49ac8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0cc expref: 412 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749534:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0cc expref: 411 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.749543:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa0249881d600) 00010000:00010000:2.0:1777580309.749545:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580309.749548:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4c00, rc 0) 00000100:00100000:2.0:1777580309.749954:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+412:282945:x1863919946581120:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5609us (8753us total) trans 8589950554 rc 0/0 00000100:00100000:2.0:1777580309.749972:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19269 00000100:00100000:2.0:1777580309.749981:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690352846 time 7830693190964 state 0x2 ref 0 00010000:00010000:0.0:1777580309.763595:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763631:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763640:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763646:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.763653:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763660:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763680:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa0249881d200) 00010000:00010000:0.0:1777580309.763682:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.763689:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.763695:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49ac1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.766630:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.766814:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766836:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766846:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766862:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.766867:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766876:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766898:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa0249881d900) 00010000:00010000:1.0:1777580309.766903:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.766910:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.766918:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ad6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.767614:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946581248 00000100:00100000:0.0:1777580309.767628:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946581248 00000100:00100000:0.0:1777580309.767673:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690352846 time 7830693190964 state 0x0 ref 1 00000100:00100000:0.0:1777580309.767688:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830693290964 time 7830693190964 state 0x1 ref 1 00000100:00100000:0.0:1777580309.767714:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830693290964 time 7830716576744 state 0x0 ref 1 00000100:00100000:0.0:1777580309.767729:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+410:282943:x1863919946581248:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.767774:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.767797:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49af2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0d3 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.767877:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49af2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0d3 expref: 411 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.767893:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49af2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0d3 expref: 411 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.767912:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:0.0:1777580309.767915:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580309.767918:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:0.0:1777580309.767987:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+411:282943:x1863919946581248:12345-192.168.202.9@tcp:101:touch.500 Request processed in 262us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580309.767996:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19270 00000100:00100000:0.0:1777580309.768001:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830693290964 time 7830716576744 state 0x2 ref 0 00010000:00010000:2.0:1777580309.771071:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771094:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771103:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771109:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.771115:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771123:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771168:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024acb37200) 00010000:00010000:2.0:1777580309.771172:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.771178:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.771184:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49ab3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.799793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.799841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.799881:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.799916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.800003:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946581504 00000100:00100000:1.0:1777580309.800018:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946581504 00000100:00100000:1.0:1777580309.800075:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830693290964 time 7830716576744 state 0x0 ref 1 00000100:00100000:1.0:1777580309.800095:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830716676744 time 7830716576744 state 0x1 ref 1 00000100:00100000:1.0:1777580309.800176:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946581760 00000100:00100000:1.0:1777580309.800180:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946581760 00000100:00100000:1.0:1777580309.800196:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830670923924 time 7830690476360 state 0x0 ref 1 00000100:00100000:1.0:1777580309.800204:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690576360 time 7830690476360 state 0x1 ref 1 00000100:00100000:1.0:1777580309.800228:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946582016 00000100:00100000:1.0:1777580309.800231:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946582016 00000100:00100000:1.0:1777580309.800245:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830690576360 time 7830690476360 state 0x1 ref 2 00000100:00100000:1.0:1777580309.800265:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830749228299 time 7830749128299 state 0x1 ref 2 00000100:00100000:1.0:1777580309.800278:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+412:282935:x1863919946581760:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.800367:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.800403:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49a0b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e094 expref: 412 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800429:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4988a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e05c expref: 411 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800461:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024acb37500) 00010000:00010000:1.0:1777580309.800474:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.800506:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800521:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800532:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800557:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800564:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800571:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800727:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800736:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.800743:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580309.801387:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1845, 64 off126272 00010000:00010000:1.0:1777580309.801466:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801478:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801488:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801497:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801504:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801519:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801539:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.801565:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801571:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801578:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801584:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.801589:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801597:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801609:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024acb37800) 00010000:00010000:1.0:1777580309.801612:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.801616:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801622:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49b07 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801640:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801661:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801666:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801672:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.801675:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801681:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801690:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.801692:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.801695:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.801702:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49af9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.801712:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001fbf960c reply state 000000005d33f3e6 transno 8589950555 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.801721:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.801833:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+412:282935:x1863919946581760:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1554us (1988us total) trans 8589950555 rc 0/0 00000100:00100000:1.0:1777580309.801843:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19272 00000100:00100000:1.0:1777580309.801901:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830716676744 time 7830750762338 state 0x0 ref 1 00000100:00100000:1.0:1777580309.802106:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+411:282945:x1863919946581504:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.802191:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.802210:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49ae4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0cc expref: 411 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802223:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa0249881d600) 00010000:00010000:1.0:1777580309.802231:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.802322:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802332:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802340:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.802673:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bde609c7 reply state 00000000ddc63a36 transno 8589950556 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.802682:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.802761:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+412:282945:x1863919946581504:12345-192.168.202.9@tcp:36:touch.500 Request processed in 838us (2984us total) trans 8589950556 rc 0/0 00000100:00100000:1.0:1777580309.802770:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19271 00000100:00100000:1.0:1777580309.802777:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830716676744 time 7830750762338 state 0x2 ref 0 00000100:00100000:1.0:1777580309.802809:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830749228299 time 7830751672063 state 0x0 ref 1 00000100:00100000:1.0:1777580309.802821:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282914:x1863919946582016:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580309.802880:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580309.802897:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4979c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e008 expref: 154 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802919:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4942a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90defe expref: 153 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802929:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7ff:0x0].0x0 (ffffa02490544200) 00010000:00010000:1.0:1777580309.802936:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.802954:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802964:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802971:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802984:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802991:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.802998:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803102:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803111:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803125:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803214:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.803221:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803228:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.803231:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803239:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803248:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d5:0x0].0x0 (ffffa024acb37800) 00010000:00010000:1.0:1777580309.803251:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.803254:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803260:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49b0e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.803274:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.803276:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.803278:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777580309.806082:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1846, 64 off126336 00010000:00010000:1.0:1777580309.806234:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806259:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806348:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806360:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806368:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806376:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806402:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580309.806432:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806439:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806524:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806533:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.806538:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806545:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806559:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7ff:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:1.0:1777580309.806563:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580309.806574:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806582:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49b2a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806610:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806618:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806624:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806628:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.806631:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806638:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806647:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.806650:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.806653:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.806658:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49b1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.806670:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fb0f6c4c reply state 0000000008b3fa46 transno 8589950557 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.806692:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580309.806905:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580309.806914:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.806934:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580309.806938:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.806945:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.806956:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7ff:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:3.0:1777580309.806959:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580309.806962:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.806970:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49b31 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.806989:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580309.806991:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580309.806993:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580309.807224:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946582144 00000100:00100000:3.0:1777580309.807236:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946582144 00000100:00100000:3.0:1777580309.807313:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11776 00000100:00100000:3.0:1777580309.807324:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946582144:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580309.811163:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282914:x1863919946582016:12345-192.168.202.9@tcp:36:rm.500 Request processed in 8313us (11250us total) trans 8589950557 rc 0/0 00000100:00100000:1.0:1777580309.811180:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19273 00000100:00100000:1.0:1777580309.811191:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830749228299 time 7830751672063 state 0x2 ref 0 00000100:00100000:3.0:1777580309.814041:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2362:x1863919946582144:12345-192.168.202.9@tcp:2:touch.500 Request processed in 6701us (14106us total) trans 8589938553 rc 0/0 00000100:00100000:3.0:1777580309.814060:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11776 00000100:00100000:0.0:1777580309.814318:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580309.814350:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814364:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814387:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814394:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.814400:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814410:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814430:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa024acb37900) 00010000:00010000:0.0:1777580309.814434:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.814440:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814575:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814584:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814599:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814604:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.814608:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814615:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814624:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024acb37f00) 00010000:00010000:3.0:1777580309.814627:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.814631:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.814638:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49b00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.814701:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49b15 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.814735:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946582400 00000100:00100000:0.0:1777580309.814747:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946582400 00000100:00100000:0.0:1777580309.814795:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830716676744 time 7830750762338 state 0x0 ref 1 00000100:00100000:0.0:1777580309.814811:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830750862338 time 7830750762338 state 0x1 ref 1 00000100:00100000:0.0:1777580309.814848:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830750862338 time 7830763708924 state 0x0 ref 1 00000100:00100000:0.0:1777580309.814873:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+410:282946:x1863919946582400:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.814901:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.814923:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49b38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0da expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815122:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815174:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815187:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815206:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815213:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.815221:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580309.819217:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159c:0x0], index 1: 0 00010000:00010000:0.0:1777580309.820975:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821007:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821023:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821092:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821117:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821124:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821131:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.821167:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821175:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821189:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.821192:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.821197:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.821204:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e49b3f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.821225:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d19a507 reply state 00000000d3d2a397 transno 8589950558 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.821235:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.822847:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49b38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0da expref: 413 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.822901:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0da expref: 412 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.822932:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa02488b85000) 00010000:00010000:0.0:1777580309.822935:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.822939:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:0.0:1777580309.823060:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+413:282946:x1863919946582400:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8188us (8741us total) trans 8589950558 rc 0/0 00000100:00100000:0.0:1777580309.823072:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19274 00000100:00100000:0.0:1777580309.823082:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830750862338 time 7830763708924 state 0x2 ref 0 00000100:00100000:0.0:1777580309.825762:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580309.833932:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.833959:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.833969:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.833976:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.833983:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.834008:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.834032:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024acb37b00) 00010000:00010000:3.0:1777580309.834035:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.834041:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.834048:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49b23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.835063:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.835124:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946582656 00000100:00100000:0.0:1777580309.835171:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946582656 00000100:00100000:0.0:1777580309.835222:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830749228299 time 7830751672063 state 0x0 ref 1 00000100:00100000:0.0:1777580309.835239:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830751772063 time 7830751672063 state 0x1 ref 1 00000100:00100000:0.0:1777580309.835964:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946582784 00000100:00100000:0.0:1777580309.835971:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946582784 00000100:00100000:0.0:1777580309.835997:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830750862338 time 7830763708924 state 0x0 ref 1 00000100:00100000:0.0:1777580309.836005:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830763808924 time 7830763708924 state 0x1 ref 1 00000100:00100000:0.0:1777580309.836034:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830751772063 time 7830784896052 state 0x0 ref 1 00000100:00100000:0.0:1777580309.836050:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:282913:x1863919946582656:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580309.836164:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580309.836199:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e497e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dffa expref: 153 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.836233:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e493f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90def0 expref: 152 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.837614:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830763808924 time 7830786469636 state 0x0 ref 1 00000100:00100000:1.0:1777580309.837650:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+413:282945:x1863919946582784:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.837680:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.837713:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e49b5b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0e1 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.837791:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e49b5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e1 expref: 414 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.837808:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e49b5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e1 expref: 414 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.838789:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fe:0x0].0x0 (ffffa024185aa400) 00010000:00010000:0.0:1777580309.838811:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.839388:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa024acb37800) 00010000:00010000:1.0:1777580309.839394:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.839399:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86a00, rc 0) 00010000:00010000:0.0:1777580309.839572:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839594:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839606:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839627:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839634:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839641:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839787:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839794:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.839801:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.840194:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+414:282945:x1863919946582784:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2553us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.840207:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19276 00000100:00100000:1.0:1777580309.840216:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830763808924 time 7830786469636 state 0x2 ref 0 00000100:00100000:3.0:1777580309.842114:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.842165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.842223:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000040:00080000:0.0:1777580309.844031:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1850, 64 off126592 00010000:00010000:0.0:1777580309.844128:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.844174:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.844189:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.844199:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.844206:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.844213:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.844599:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946583552 00000100:00100000:3.0:1777580309.844612:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946583552 00010000:00010000:0.0:1777580309.846425:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580309.846648:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846663:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846670:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846677:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.846682:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846709:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846729:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fe:0x0].0x0 (ffffa02488b85600) 00010000:00010000:0.0:1777580309.846732:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580309.846739:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846746:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e49b70 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846779:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846787:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846793:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846799:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.846802:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846809:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846817:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.846820:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.846822:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.846838:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e49b62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.846864:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000875284ca reply state 0000000002d58e34 transno 8589950559 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.846875:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.847026:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:282913:x1863919946582656:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10975us (21271us total) trans 8589950559 rc 0/0 00000100:00100000:0.0:1777580309.847038:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19275 00000100:00100000:0.0:1777580309.847049:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830751772063 time 7830784896052 state 0x2 ref 0 00000100:00100000:0.0:1777580309.847096:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946583040 00000100:00100000:0.0:1777580309.847105:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946583040 00000100:00100000:0.0:1777580309.847162:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830763808924 time 7830786469636 state 0x0 ref 1 00000100:00100000:0.0:1777580309.847177:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830786569636 time 7830786469636 state 0x1 ref 1 00000100:00100000:0.0:1777580309.847194:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946583296 00000100:00100000:0.0:1777580309.847198:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946583296 00000100:00100000:0.0:1777580309.847215:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830786569636 time 7830786469636 state 0x1 ref 2 00000100:00100000:0.0:1777580309.847235:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830796197237 time 7830796097237 state 0x1 ref 2 00000100:00100000:0.0:1777580309.847247:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+416:282946:x1863919946583040:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580309.849704:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580309.849753:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0da expref: 416 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.849802:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa02488b85000) 00010000:00010000:0.0:1777580309.849943:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.850047:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.850065:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.850077:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.850286:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003154f7d6 reply state 00000000d8d600c8 transno 8589950560 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.850297:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.850421:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+417:282946:x1863919946583040:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3173us (8316us total) trans 8589950560 rc 0/0 00000100:00100000:0.0:1777580309.851363:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19277 00000100:00100000:0.0:1777580309.851425:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830796197237 time 7830800284116 state 0x0 ref 1 00000100:00100000:3.0:1777580309.851745:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4135 00000100:00100000:3.0:1777580309.851767:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+416:282943:x1863919946583552:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580309.851951:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+416:282942:x1863919946583296:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580309.851965:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580309.851991:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49b85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0e8 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852157:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852193:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852205:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852224:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852231:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.852237:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.855987:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:282943:x1863919946583552:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4213us (13746us total) trans 8589950561 rc 0/0 00000100:00100000:3.0:1777580309.856005:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4135 00000100:00100000:3.0:1777580309.856269:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:0.0:1777580309.857286:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c1:0x0], index 0: 0 00010000:00010000:0.0:1777580309.859797:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e49b9a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860030:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860040:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860060:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860067:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.860072:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860081:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860098:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02488b85300) 00010000:00010000:3.0:1777580309.860101:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.860107:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.860112:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e49b69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.861964:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e49b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.861994:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e49b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862088:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862097:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862105:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862120:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.862125:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862147:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862163:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.862166:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.862171:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862178:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e49b8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.862203:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009d418b6b reply state 00000000a028aefb transno 8589950562 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.862215:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580309.862278:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea3800/0xcb2b2f2f7e49b85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e8 expref: 419 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862300:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e49b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e8 expref: 418 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.862309:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa02498a66000) 00010000:00010000:0.0:1777580309.862311:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580309.862314:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fce00, rc 0) 00000100:00100000:0.0:1777580309.862426:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:282942:x1863919946583296:12345-192.168.202.9@tcp:101:touch.500 Request processed in 10481us (20258us total) trans 8589950562 rc 0/0 00010000:00010000:1.0:1777580309.863660:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.863671:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863681:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.863686:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863693:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863707:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fe:0x0].0x0 (ffffa02488b85600) 00010000:00010000:1.0:1777580309.863710:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.863713:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863719:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e49b77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863745:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.863747:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.863749:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.863766:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863773:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863780:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863785:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.863803:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863809:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.863818:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02488b85b00) 00000100:00100000:3.0:1777580309.864969:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580309.865593:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.865605:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865617:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e49b46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865664:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865672:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865680:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865686:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.865690:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865696:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865711:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa02481358800) 00010000:00010000:1.0:1777580309.865714:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.865733:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.865739:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e49b7e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.865777:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946583808 00000100:00100000:1.0:1777580309.865790:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946583808 00000100:00100000:1.0:1777580309.865843:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830800384116 time 7830800284116 state 0x1 ref 2 00000100:00100000:1.0:1777580309.865882:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830800384116 time 7830814743124 state 0x0 ref 2 00000100:00100000:1.0:1777580309.865897:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:282946:x1863919946583808:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.865929:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.865952:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49ba8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0ef expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.866026:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0ef expref: 419 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.866041:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0ef expref: 419 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.866061:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa024acb37500) 00010000:00010000:1.0:1777580309.866064:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.866067:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e87a00, rc 0) 00000100:00100000:1.0:1777580309.866180:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:282946:x1863919946583808:12345-192.168.202.9@tcp:101:touch.500 Request processed in 286us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.866188:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19279 00000100:00100000:0.0:1777580309.867609:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19278 00000100:00100000:0.0:1777580309.867618:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830800384116 time 7830814743124 state 0x2 ref 0 00000100:00100000:2.0:1777580309.872345:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946583680 00000100:00100000:2.0:1777580309.872366:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946583680 00000100:00100000:2.0:1777580309.872465:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11777 00000100:00100000:2.0:1777580309.872478:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2361:x1863919946583680:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580309.872946:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2361:x1863919946583680:12345-192.168.202.9@tcp:2:touch.500 Request processed in 469us (16677us total) trans 8589938953 rc 0/0 00000100:00100000:2.0:1777580309.872956:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11777 00000100:00100000:3.0:1777580309.881905:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.881950:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.881971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580309.882173:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882188:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882196:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882204:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.882210:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882218:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882238:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024993dfa00) 00010000:00010000:0.0:1777580309.882242:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.882248:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882255:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e49b93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.882310:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946584064 00000100:00100000:0.0:1777580309.882322:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946584064 00000100:00100000:0.0:1777580309.882364:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830751772063 time 7830784896052 state 0x0 ref 1 00000100:00100000:0.0:1777580309.882399:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830784996052 time 7830784896052 state 0x1 ref 1 00000100:00100000:0.0:1777580309.882420:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946584320 00000100:00100000:0.0:1777580309.882424:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946584320 00000100:00100000:0.0:1777580309.882608:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830800384116 time 7830814743124 state 0x0 ref 1 00000100:00100000:0.0:1777580309.882618:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830814843124 time 7830814743124 state 0x1 ref 1 00000100:00100000:0.0:1777580309.882634:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946584576 00000100:00100000:0.0:1777580309.882638:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946584576 00000100:00100000:0.0:1777580309.882653:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830814843124 time 7830814743124 state 0x1 ref 2 00000100:00100000:0.0:1777580309.882674:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830784996052 time 7830831536020 state 0x0 ref 1 00000100:00100000:0.0:1777580309.882688:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:282912:x1863919946584064:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580309.882766:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580309.882790:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49772 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dff3 expref: 152 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882809:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e493d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dee2 expref: 151 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882927:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fd:0x0].0x0 (ffffa024185ac900) 00010000:00010000:0.0:1777580309.882938:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.882970:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.882988:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883014:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883032:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883041:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883048:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883246:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883255:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.883263:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.885675:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830834628870 time 7830834528870 state 0x1 ref 2 00000100:00100000:3.0:1777580309.885712:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:282942:x1863919946584320:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580309.885794:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580309.885841:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e49b9a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e8 expref: 418 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.885891:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa02498a66000) 00010000:00010000:3.0:1777580309.885904:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580309.886003:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.886019:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.886031:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.886188:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000176bddf8 reply state 000000003ea0e6f7 transno 8589950563 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.886200:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.886337:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:282942:x1863919946584320:12345-192.168.202.9@tcp:36:touch.500 Request processed in 639us (4383us total) trans 8589950563 rc 0/0 00000100:00100000:3.0:1777580309.886346:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19281 00000100:00100000:3.0:1777580309.886383:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830834628870 time 7830835245465 state 0x0 ref 1 00000100:00100000:3.0:1777580309.886395:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:282939:x1863919946584576:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580309.886408:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.886422:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49bcb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0f6 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.886998:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.887032:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.887042:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.887062:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.887070:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.887077:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580309.887596:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1847, 64 off126400 00010000:00010000:0.0:1777580309.887693:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887708:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887718:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887728:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887742:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887750:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887777:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580309.887802:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887809:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.887817:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580309.888273:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159d:0x0], index 1: 0 00010000:00010000:0.0:1777580309.888596:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.888603:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888612:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888628:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fd:0x0].0x0 (ffffa02499549700) 00010000:00010000:0.0:1777580309.888632:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580309.888637:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888645:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49bbd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888687:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888694:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888700:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888706:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.888709:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888715:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888724:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580309.888726:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.888730:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.888735:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49baf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.888747:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001362bf4f reply state 000000003aea0b4b transno 8589950564 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.888757:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580309.889023:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.889030:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.889037:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.889040:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.889047:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.889056:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7fd:0x0].0x0 (ffffa02499549700) 00010000:00010000:1.0:1777580309.889058:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.889061:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.889067:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e49be0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.889086:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.889088:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.889090:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580309.891084:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:282912:x1863919946584064:12345-192.168.202.9@tcp:36:rm.500 Request processed in 8382us (9176us total) trans 8589950564 rc 0/0 00000100:00100000:0.0:1777580309.891101:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19280 00000100:00100000:0.0:1777580309.891124:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830784996052 time 7830831536020 state 0x2 ref 0 00010000:00010000:3.0:1777580309.898749:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49be7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898777:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49be7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898791:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49be7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898866:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898874:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898881:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898903:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.898908:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898916:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898931:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.898934:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.898938:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.898945:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e49bd2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.898960:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b16e7e46 reply state 00000000da0c6147 transno 8589950565 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.898970:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580309.899019:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e49bcb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0f6 expref: 421 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.899035:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49be7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0f6 expref: 420 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.899043:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa024185aa300) 00010000:00010000:3.0:1777580309.899046:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580309.899048:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20800, rc 0) 00000100:00100000:3.0:1777580309.899186:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+421:282939:x1863919946584576:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12791us (17211us total) trans 8589950565 rc 0/0 00000100:00100000:3.0:1777580309.899203:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19282 00000100:00100000:3.0:1777580309.899213:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830834628870 time 7830835245465 state 0x2 ref 0 00010000:00010000:2.0:1777580309.919906:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919929:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919937:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919944:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.919950:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919959:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919982:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa024185aa000) 00010000:00010000:2.0:1777580309.919985:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.919991:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.919999:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e49bc4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.921117:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921204:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921229:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.921363:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946584832 00000100:00100000:0.0:1777580309.921375:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946584832 00000100:00100000:0.0:1777580309.921438:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4136 00000100:00100000:1.0:1777580309.921950:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946584960 00000100:00100000:1.0:1777580309.921957:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946584960 00000100:00100000:1.0:1777580309.922003:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11778 00000100:00100000:1.0:1777580309.922013:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2364:x1863919946584960:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:2.0:1777580309.922756:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922772:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922797:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922805:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.922811:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922820:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922839:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024185aaf00) 00010000:00010000:2.0:1777580309.922843:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.922847:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.922865:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e49bd9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.923310:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946585088 00000100:00100000:0.0:1777580309.923311:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:282945:x1863919946584832:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580309.923318:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946585088 00000100:00100000:2.0:1777580309.923352:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830834628870 time 7830835245465 state 0x0 ref 1 00000100:00100000:2.0:1777580309.923364:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830835345465 time 7830835245465 state 0x1 ref 1 00000100:00100000:2.0:1777580309.923386:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946585344 00000100:00100000:2.0:1777580309.923389:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946585344 00000100:00100000:2.0:1777580309.923403:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830784996052 time 7830831536020 state 0x0 ref 1 00000100:00100000:2.0:1777580309.923409:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830831636020 time 7830831536020 state 0x1 ref 1 00000100:00100000:2.0:1777580309.923444:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946585600 00000100:00100000:2.0:1777580309.923447:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946585600 00000100:00100000:2.0:1777580309.923461:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830831636020 time 7830831536020 state 0x1 ref 2 00000100:00100000:2.0:1777580309.923474:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946585728 00000100:00100000:2.0:1777580309.923476:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946585728 00000100:00100000:2.0:1777580309.923489:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830835345465 time 7830835245465 state 0x1 ref 2 00000100:00100000:2.0:1777580309.923507:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872469047 time 7830872369047 state 0x1 ref 2 00000100:00100000:2.0:1777580309.923518:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:282916:x1863919946585344:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580309.923558:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580309.923581:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e497c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e00f expref: 152 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923599:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49581 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x800:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df75 expref: 151 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923612:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x800:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:2.0:1777580309.923623:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580309.923654:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.923660:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872621133 time 7830872521133 state 0x1 ref 2 00010000:00010000:2.0:1777580309.923670:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.923673:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024a57e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+422:282942:x1863919946585088:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.923682:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.923688:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.923705:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.923706:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e49c03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e0fd expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923713:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923720:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.923749:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e49c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0fd expref: 423 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.923762:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e49c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0fd expref: 423 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.923782:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580309.923785:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580309.923788:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fc600, rc 0) 00010000:00010000:2.0:1777580309.923864:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923873:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.923879:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.924056:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024a57e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282942:x1863919946585088:12345-192.168.202.9@tcp:101:touch.500 Request processed in 385us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.924065:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19283 00000040:00080000:2.0:1777580309.924427:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1851, 64 off126656 00010000:00010000:2.0:1777580309.924495:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924508:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924518:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924526:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924533:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924546:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924566:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580309.924591:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924596:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924602:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924608:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.924612:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924619:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924630:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x800:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:2.0:1777580309.924632:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580309.924635:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924641:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c0a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924659:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924673:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924679:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924683:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.924686:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924691:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924698:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.924700:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.924702:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924707:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49bf5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.924717:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000072484126 reply state 0000000092dec4b4 transno 8589950566 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.924726:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.924736:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282945:x1863919946584832:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3287us (3629us total) trans 8589950567 rc 0/0 00000100:00100000:0.0:1777580309.924745:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4136 00000100:00100000:2.0:1777580309.924759:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:282916:x1863919946585344:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1243us (3530us total) trans 8589950566 rc 0/0 00000100:00100000:2.0:1777580309.924766:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19284 00000100:00100000:2.0:1777580309.924789:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872469047 time 7830873651219 state 0x0 ref 1 00000100:00100000:2.0:1777580309.924809:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+422:282959:x1863919946585600:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:0.0:1777580309.924812:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872621133 time 7830873674872 state 0x0 ref 1 00010000:00010000:2.0:1777580309.924824:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.924834:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e104 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924899:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924908:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924916:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924930:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924937:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.924943:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925012:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925021:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925027:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580309.925065:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d8:0x0]: returning size 0 00000004:00200000:2.0:1777580309.925070:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580309.925085:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925095:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925103:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.925108:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2364:x1863919946584960:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3096us (3851us total) trans 8589938554 rc 0/0 00010000:00010000:2.0:1777580309.925109:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925115:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925120:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:1.0:1777580309.925120:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11778 00010000:00010000:2.0:1777580309.925123:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925128:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925155:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.925158:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.925161:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925167:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925170:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.925181:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925185:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925187:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.925190:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925191:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925197:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925197:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925203:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.925205:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925207:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x800:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:1.0:1777580309.925209:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580309.925212:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925212:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925218:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49c11 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925220:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0249881d600) 00010000:00010000:2.0:1777580309.925222:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.925224:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925228:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.925232:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.925234:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.925235:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.925253:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49c18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e104 expref: 424 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925266:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e104 expref: 423 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925286:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:2.0:1777580309.925288:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580309.925291:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:2.0:1777580309.925313:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282959:x1863919946585600:12345-192.168.202.9@tcp:101:rm.500 Request processed in 507us (4028us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580309.925319:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19285 00000100:00100000:2.0:1777580309.925323:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872469047 time 7830873651219 state 0x2 ref 0 00010000:00010000:2.0:1777580309.925351:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925359:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925365:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925371:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.925374:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925379:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.925388:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02498a66600) 00010000:00010000:2.0:1777580309.925390:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.925393:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.925405:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+422:282939:x1863919946585728:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580309.925408:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49bb6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.925576:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580309.925595:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e49be7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0f6 expref: 422 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.925609:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa024185aa300) 00010000:00010000:0.0:1777580309.925617:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580309.925690:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.925710:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.925718:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580309.927626:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000330a10e reply state 000000007a145fb0 transno 8589950568 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.927649:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580309.927803:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282939:x1863919946585728:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2975us (6472us total) trans 8589950568 rc 0/0 00000100:00100000:0.0:1777580309.927814:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19286 00000100:00100000:0.0:1777580309.929673:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872621133 time 7830873674872 state 0x2 ref 0 00010000:00010000:0.0:1777580309.940204:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940226:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940234:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940242:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580309.940247:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940256:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940297:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa02499549300) 00010000:00010000:0.0:1777580309.940300:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580309.940306:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580309.940313:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e49c34 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580309.940385:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.940942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580309.941490:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941503:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941525:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941532:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.941535:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941542:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941555:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0249881db00) 00010000:00010000:3.0:1777580309.941558:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.941561:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.941568:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49bfc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.941616:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946586112 00000100:00100000:3.0:1777580309.941629:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946586112 00000100:00100000:3.0:1777580309.941701:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4137 00000100:00100000:3.0:1777580309.941712:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+422:282946:x1863919946586112:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580309.942237:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282946:x1863919946586112:12345-192.168.202.9@tcp:35:touch.500 Request processed in 526us (1855us total) trans 8589950569 rc 0/0 00000100:00100000:3.0:1777580309.942255:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4137 00000100:00100000:3.0:1777580309.946701:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946585856 00000100:00100000:3.0:1777580309.946720:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946585856 00000100:00100000:3.0:1777580309.946893:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11779 00000100:00100000:3.0:1777580309.946924:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2364:x1863919946585856:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580309.947409:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2364:x1863919946585856:12345-192.168.202.9@tcp:2:touch.500 Request processed in 488us (6466us total) trans 8589938954 rc 0/0 00000100:00100000:3.0:1777580309.947419:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11779 00000100:00100000:0.0:1777580309.947748:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580309.947902:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.948273:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946586368 00000100:00100000:3.0:1777580309.948281:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946586368 00000100:00100000:3.0:1777580309.948330:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11780 00000100:00100000:3.0:1777580309.948339:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2363:x1863919946586368:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580309.948358:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580309.948388:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e112 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580309.948421:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159b:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:3.0:1777580309.948675:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580309.948679:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580309.948690:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 33 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.948713:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 33 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.948729:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fce00, rc 0) 00000100:00100000:1.0:1777580309.948915:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946586240 00000100:00100000:1.0:1777580309.948923:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946586240 00000100:00100000:1.0:1777580309.948958:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872621133 time 7830873674872 state 0x0 ref 1 00000100:00100000:1.0:1777580309.948971:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873774872 time 7830873674872 state 0x1 ref 1 00000100:00100000:1.0:1777580309.948995:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873774872 time 7830897856751 state 0x0 ref 1 00000100:00100000:1.0:1777580309.949006:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:282939:x1863919946586240:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.949022:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.949057:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e49c42 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e10b expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.949123:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e49c42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e10b expref: 424 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.949162:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e49c42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e10b expref: 424 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.949182:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa024acb37900) 00010000:00010000:1.0:1777580309.949185:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580309.949189:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:3.0:1777580309.949262:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2363:x1863919946586368:12345-192.168.202.9@tcp:101:rm.500 Request processed in 923us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580309.949270:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11780 00000100:00100000:1.0:1777580309.955096:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+424:282939:x1863919946586240:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6066us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580309.955114:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19287 00000100:00100000:1.0:1777580309.955129:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873774872 time 7830897856751 state 0x2 ref 0 00000100:00100000:2.0:1777580309.963226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.963344:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.963470:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946586624 00000100:00100000:2.0:1777580309.963483:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946586624 00000100:00100000:2.0:1777580309.963537:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830872469047 time 7830873651219 state 0x0 ref 1 00000100:00100000:2.0:1777580309.963555:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873751219 time 7830873651219 state 0x1 ref 1 00000100:00100000:2.0:1777580309.963578:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946586880 00000100:00100000:2.0:1777580309.963581:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946586880 00000100:00100000:2.0:1777580309.963595:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873774872 time 7830897856751 state 0x0 ref 1 00000100:00100000:2.0:1777580309.963602:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830897956751 time 7830897856751 state 0x1 ref 1 00000100:00100000:2.0:1777580309.963628:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873751219 time 7830912489943 state 0x0 ref 1 00000100:00100000:2.0:1777580309.963641:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282924:x1863919946586624:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580309.963721:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580309.963756:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e49813 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e001 expref: 150 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963782:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4964c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x802:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfad expref: 149 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963797:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa02483f8ef00) 00010000:00010000:2.0:1777580309.963837:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580309.963880:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963898:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963910:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963927:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963933:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.963940:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964098:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964108:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964116:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580309.964738:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1852, 64 off126720 00010000:00010000:2.0:1777580309.964820:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964833:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964865:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964873:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964880:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964887:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964914:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580309.964940:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964947:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964953:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964960:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.964964:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964972:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.964984:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa0249881d200) 00010000:00010000:2.0:1777580309.964987:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580309.964997:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965005:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49c57 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965028:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965035:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965040:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965046:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.965049:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965055:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965063:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.965066:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.965069:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965074:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49c49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.965084:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e36acea5 reply state 00000000acc927b0 transno 8589950570 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.965104:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580309.965241:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282924:x1863919946586624:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1597us (2026us total) trans 8589950570 rc 0/0 00000100:00100000:2.0:1777580309.965251:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19288 00000100:00100000:2.0:1777580309.965258:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873751219 time 7830912489943 state 0x2 ref 0 00000100:00100000:2.0:1777580309.965303:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830897956751 time 7830914165426 state 0x0 ref 1 00000100:00100000:2.0:1777580309.965317:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+424:282949:x1863919946586880:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580309.965342:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580309.965356:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49c65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e119 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965463:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965472:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965480:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965495:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965502:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.965510:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580309.969311:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c2:0x0], index 0: 0 00010000:00010000:2.0:1777580309.969601:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c7a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969624:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969640:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969691:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969700:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969706:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969713:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580309.969719:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969727:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969743:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580309.969746:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580309.969752:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.969779:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49c6c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580309.969798:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fc91e90a reply state 0000000065304b60 transno 8589950571 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580309.969808:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580309.970010:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49c65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e119 expref: 427 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970029:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e119 expref: 426 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970037:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:2.0:1777580309.970039:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580309.970042:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00000100:00100000:2.0:1777580309.970176:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:282949:x1863919946586880:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4862us (6830us total) trans 8589950571 rc 0/0 00000100:00100000:2.0:1777580309.970188:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19289 00000100:00100000:2.0:1777580309.970197:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830897956751 time 7830914165426 state 0x2 ref 0 00010000:00010000:2.0:1777580309.970553:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580309.970561:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970570:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580309.970574:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970593:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970604:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x802:0x0].0x0 (ffffa0249881d200) 00010000:00010000:2.0:1777580309.970606:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580309.970610:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970615:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49c5e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580309.970632:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.970634:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580309.970636:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.986379:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986404:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986412:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986419:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.986425:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986449:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986470:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa0249881d900) 00010000:00010000:1.0:1777580309.986473:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.986479:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.986486:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49c73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.986563:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.986653:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580309.986713:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986727:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986733:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986737:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.986741:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986746:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986756:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0249881d600) 00010000:00010000:3.0:1777580309.986758:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.986761:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.986767:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49c50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.986810:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946587264 00000100:00100000:3.0:1777580309.986823:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946587264 00000100:00100000:3.0:1777580309.990178:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830873751219 time 7830912489943 state 0x0 ref 1 00000100:00100000:3.0:1777580309.990200:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830912589943 time 7830912489943 state 0x1 ref 1 00000100:00100000:3.0:1777580309.990242:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830912589943 time 7830939104694 state 0x0 ref 1 00000100:00100000:3.0:1777580309.990268:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282921:x1863919946587264:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580309.990374:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580309.990416:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4974f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfec expref: 149 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990447:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49622 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x801:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfa6 expref: 148 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990465:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580309.990477:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580309.990511:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990530:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990542:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990562:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990569:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990576:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990735:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990743:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.990759:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580309.991418:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1848, 64 off126464 00010000:00010000:3.0:1777580309.991503:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991516:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991526:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991534:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991541:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991547:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991569:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580309.991594:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991600:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991607:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991625:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.991630:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991638:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991649:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa024185ac100) 00010000:00010000:3.0:1777580309.991651:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580309.991656:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991663:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49c96 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991684:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991691:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991696:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991702:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580309.991705:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991710:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991727:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580309.991730:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580309.991733:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580309.991738:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49c88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580309.991747:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004eecef3d reply state 00000000ba8d466f transno 8589950572 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580309.991757:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580309.991890:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282921:x1863919946587264:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1632us (5231us total) trans 8589950572 rc 0/0 00000100:00100000:3.0:1777580309.991901:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19290 00000100:00100000:3.0:1777580309.991909:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830912589943 time 7830939104694 state 0x2 ref 0 00000100:00100000:3.0:1777580309.992023:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580309.992162:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946587008 00000100:00100000:2.0:1777580309.992173:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946587008 00000100:00100000:2.0:1777580309.992225:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11781 00000100:00100000:2.0:1777580309.992236:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2364:x1863919946587008:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580309.992553:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2364:x1863919946587008:12345-192.168.202.9@tcp:2:touch.500 Request processed in 318us (5994us total) trans 8589938555 rc 0/0 00000100:00100000:2.0:1777580309.992561:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11781 00010000:00010000:1.0:1777580309.992670:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580309.992680:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.992688:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580309.992693:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.992701:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.992713:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x801:0x0].0x0 (ffffa024185ac100) 00010000:00010000:1.0:1777580309.992715:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580309.992719:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.992725:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49c9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.992752:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.992754:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580309.992755:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580309.993220:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580309.993249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580309.997035:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946587776 00000100:00100000:1.0:1777580309.997127:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946587776 00000100:00100000:1.0:1777580309.997202:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830897956751 time 7830914165426 state 0x0 ref 1 00000100:00100000:1.0:1777580309.997218:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830914265426 time 7830914165426 state 0x1 ref 1 00000100:00100000:1.0:1777580309.997247:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946588032 00000100:00100000:1.0:1777580309.997250:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946588032 00000100:00100000:1.0:1777580309.997262:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830914265426 time 7830914165426 state 0x1 ref 2 00000100:00100000:1.0:1777580309.997282:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830946245320 time 7830946145320 state 0x1 ref 2 00000100:00100000:1.0:1777580309.997300:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:282949:x1863919946587776:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580309.997672:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580309.997711:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49c7a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e119 expref: 427 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.997738:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:1.0:1777580309.997752:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580309.997864:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.997881:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.997892:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580309.998077:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000eb4a9d8f reply state 00000000c894473c transno 8589950573 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580309.998088:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580309.998252:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+428:282949:x1863919946587776:12345-192.168.202.9@tcp:36:touch.500 Request processed in 957us (5031us total) trans 8589950573 rc 0/0 00000100:00100000:1.0:1777580309.998263:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19291 00000100:00100000:1.0:1777580309.998296:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830946245320 time 7830947158264 state 0x0 ref 1 00000100:00100000:1.0:1777580309.998309:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:282965:x1863919946588032:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580309.998322:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580309.998339:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49cab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e120 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998500:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998512:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998522:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998537:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998544:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998565:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998639:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49cc0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998648:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998655:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580309.998665:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x804:0x0]: returning size 0 00010000:00010000:1.0:1777580309.998737:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998745:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998752:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998759:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.998764:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998772:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998783:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580309.998786:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.998796:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998802:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49cb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998817:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998824:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998829:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998835:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1c200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580309.998838:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998843:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998864:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024acb37f00) 00010000:00010000:1.0:1777580309.998867:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580309.998869:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998876:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e49cb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998916:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49cab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e120 expref: 430 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998945:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e120 expref: 429 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580309.998954:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:1.0:1777580309.998956:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580309.998959:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c800, rc 0) 00000100:00100000:1.0:1777580309.998995:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+429:282965:x1863919946588032:12345-192.168.202.9@tcp:101:touch.500 Request processed in 690us (5746us total) trans 8589950574 rc 0/0 00000100:00100000:1.0:1777580309.999002:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19292 00000100:00100000:1.0:1777580309.999007:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830946245320 time 7830947158264 state 0x2 ref 0 00000100:00100000:0.0:1777580310.000022:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946587520 00000100:00100000:0.0:1777580310.000040:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946587520 00000100:00100000:0.0:1777580310.003811:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4138 00000100:00100000:0.0:1777580310.003860:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+429:282942:x1863919946587520:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580310.004397:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+430:282942:x1863919946587520:12345-192.168.202.9@tcp:35:touch.500 Request processed in 568us (12372us total) trans 8589950575 rc 0/0 00000100:00100000:0.0:1777580310.004406:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4138 00000100:00100000:3.0:1777580310.004925:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.006183:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.006200:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.006208:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.006234:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.006240:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.006260:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.006279:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024185ac900) 00010000:00010000:1.0:1777580310.007419:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007437:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007444:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007451:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.007455:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007463:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007479:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa024acb37b00) 00010000:00010000:1.0:1777580310.007500:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.007507:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.007514:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49ca4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.007728:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.007737:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.007745:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49c8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.011158:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946588288 00000100:00100000:2.0:1777580310.011178:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946588288 00000100:00100000:2.0:1777580310.011278:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4139 00000100:00100000:2.0:1777580310.011300:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+429:282939:x1863919946588288:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580310.011790:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+430:282939:x1863919946588288:12345-192.168.202.9@tcp:35:touch.500 Request processed in 492us (6868us total) trans 8589950576 rc 0/0 00000100:00100000:2.0:1777580310.011814:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4139 00000100:00100000:1.0:1777580310.013548:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.013600:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946588416 00000100:00100000:1.0:1777580310.013611:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946588416 00000100:00100000:1.0:1777580310.013673:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830946245320 time 7830947158264 state 0x0 ref 1 00000100:00100000:1.0:1777580310.013687:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830947258264 time 7830947158264 state 0x1 ref 1 00000100:00100000:1.0:1777580310.013712:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830947258264 time 7830962573303 state 0x0 ref 1 00000100:00100000:1.0:1777580310.013726:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+430:282949:x1863919946588416:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.013749:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.013780:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e49cce lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e127 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.013863:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e49cce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e127 expref: 431 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.013881:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e49cce lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e127 expref: 431 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.013903:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:1.0:1777580310.013907:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580310.013925:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1ce00, rc 0) 00000100:00100000:1.0:1777580310.013992:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+431:282949:x1863919946588416:12345-192.168.202.9@tcp:101:touch.500 Request processed in 269us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.014002:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19293 00000100:00100000:1.0:1777580310.014008:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830947258264 time 7830962573303 state 0x2 ref 0 00000100:00080000:1.0:1777580310.014038:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580310.022582:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.022621:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.022643:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.027578:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.028053:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946588672 00000100:00100000:3.0:1777580310.028069:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946588672 00000100:00100000:3.0:1777580310.028124:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830947258264 time 7830962573303 state 0x0 ref 1 00000100:00100000:3.0:1777580310.028169:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830962673303 time 7830962573303 state 0x1 ref 1 00000100:00100000:3.0:1777580310.028191:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946588928 00000100:00100000:3.0:1777580310.028194:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946588928 00000100:00100000:3.0:1777580310.028205:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830962673303 time 7830962573303 state 0x1 ref 2 00000100:00100000:3.0:1777580310.028216:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589056 00000100:00100000:3.0:1777580310.028219:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589056 00000100:00100000:3.0:1777580310.028229:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830912589943 time 7830939104694 state 0x0 ref 1 00000100:00100000:3.0:1777580310.028235:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830939204694 time 7830939104694 state 0x1 ref 1 00000100:00100000:2.0:1777580310.028374:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589184 00000100:00100000:2.0:1777580310.028379:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589184 00000100:00100000:2.0:1777580310.028546:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830939204694 time 7830939104694 state 0x1 ref 2 00000100:00100000:2.0:1777580310.028569:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830977531223 time 7830977431223 state 0x1 ref 2 00000100:00100000:2.0:1777580310.028584:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282930:x1863919946589056:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.028615:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.028645:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49cd5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e135 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028737:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028756:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028771:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028788:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028796:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.028812:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029169:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029180:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029189:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.029225:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x804:0x0]: returning size 0 00000004:00200000:2.0:1777580310.029230:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.029367:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029382:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029391:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029398:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029404:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029410:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.029414:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029432:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029447:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.029451:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.029456:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029463:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e49cdc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029478:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029485:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029491:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029496:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.029499:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029506:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029513:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0249881d200) 00010000:00010000:2.0:1777580310.029515:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.029518:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029530:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ce3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029576:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49cd5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 151 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029593:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 150 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.029601:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.029603:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.029606:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:2.0:1777580310.029700:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282930:x1863919946589056:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1120us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.029711:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19296 00000100:00100000:2.0:1777580310.029752:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830978713640 time 7830978613640 state 0x1 ref 2 00000100:00100000:2.0:1777580310.029768:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+432:282950:x1863919946588672:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.029790:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.029802:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49cf1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e12e expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.032509:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830977531223 time 7830981360911 state 0x0 ref 1 00000100:00100000:3.0:1777580310.032552:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282928:x1863919946589184:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.032583:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.032611:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49cf8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e13c expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032704:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032723:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032736:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032754:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032760:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.032766:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.033192:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830978713640 time 7830982051955 state 0x0 ref 2 00000100:00100000:2.0:1777580310.033212:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+433:282965:x1863919946588928:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580310.033433:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033445:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033473:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580310.033509:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x803:0x0]: returning size 0 00000004:00200000:3.0:1777580310.033514:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580310.033539:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033553:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033562:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033569:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033576:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033583:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.033587:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033595:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033607:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.033611:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.033616:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033637:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49cff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033652:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033658:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033664:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033669:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.033672:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033678:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033686:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024185ac100) 00010000:00010000:3.0:1777580310.033688:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.033691:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033696:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033734:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49cf8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e13c expref: 151 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033763:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e13c expref: 150 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.033771:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02486090600) 00010000:00010000:3.0:1777580310.033773:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.033776:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00010000:00010000:2.0:1777580310.036020:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.036096:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49cc0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e120 expref: 433 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.036127:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.036148:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580310.036544:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282928:x1863919946589184:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4008us (8977us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.036559:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19297 00000100:00100000:3.0:1777580310.036568:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830977531223 time 7830981360911 state 0x2 ref 0 00010000:00010000:3.0:1777580310.036727:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.036747:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.036760:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.036779:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.036787:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.036794:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.041982:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.042022:0:188495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 149 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.042034:0:188495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.042105:0:188495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 149 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.042126:0:188495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 149 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.042163:0:188495:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385e94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188495:1863919917458688:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580310.042284:0:188495:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285600 going to sleep for 11 seconds 00000004:00080000:3.0:1777580310.043742:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159e:0x0], index 1: 0 00010000:00010000:3.0:1777580310.044120:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e49d29 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044170:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e49d29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044187:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e49d29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044238:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044246:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044255:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044261:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.044266:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044274:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044289:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.044292:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.044297:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044320:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.044338:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000038878bee reply state 00000000590f2398 transno 8589950577 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.044349:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580310.044400:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49cf1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e12e expref: 434 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044418:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e49d29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e12e expref: 433 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.044427:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa024997a0b00) 00010000:00010000:3.0:1777580310.044430:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.044432:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:3.0:1777580310.044520:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:282950:x1863919946588672:12345-192.168.202.9@tcp:101:touch.500 Request processed in 14757us (21954us total) trans 8589950577 rc 0/0 00000100:00100000:3.0:1777580310.044533:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19294 00000100:00100000:2.0:1777580310.044801:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.047490:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589312 00000100:00100000:3.0:1777580310.047511:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589312 00000100:00100000:3.0:1777580310.047682:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11782 00000100:00100000:3.0:1777580310.047695:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2362:x1863919946589312:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.048557:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2362:x1863919946589312:12345-192.168.202.9@tcp:2:touch.500 Request processed in 860us (3752us total) trans 8589938955 rc 0/0 00000100:00100000:3.0:1777580310.048568:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11782 00010000:00010000:3.0:1777580310.048628:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048640:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048649:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048656:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.048661:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048670:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048689:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024997a0a00) 00010000:00010000:3.0:1777580310.048692:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.048697:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.048704:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49d22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.054312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.054402:0:188495:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385e94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188495:1863919917458688:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580310.054442:0:188495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.057485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.057518:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.057536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.057570:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589568 00000100:00100000:2.0:1777580310.057583:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589568 00000100:00100000:2.0:1777580310.057644:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830977531223 time 7830981360911 state 0x0 ref 1 00000100:00100000:2.0:1777580310.057660:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830981460911 time 7830981360911 state 0x1 ref 1 00000100:00100000:2.0:1777580310.057683:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589696 00000100:00100000:2.0:1777580310.057687:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589696 00000100:00100000:2.0:1777580310.057698:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830981460911 time 7830981360911 state 0x1 ref 2 00000100:00100000:2.0:1777580310.057712:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589824 00000100:00100000:2.0:1777580310.057714:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589824 00000100:00100000:2.0:1777580310.057725:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830981460911 time 7830981360911 state 0x1 ref 3 00000100:00100000:2.0:1777580310.057744:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831006706162 time 7831006606162 state 0x1 ref 3 00000100:00100000:2.0:1777580310.057756:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282930:x1863919946589568:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.057780:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.057806:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49d37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e14a expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.058003:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831006963937 time 7831006863937 state 0x1 ref 3 00000100:00100000:3.0:1777580310.058017:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:282951:x1863919946589696:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.058039:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.058050:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49d3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e151 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058181:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058199:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058217:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058235:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058243:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058249:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058366:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058374:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058382:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058388:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.058401:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058409:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058423:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.058427:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.058433:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058441:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e49d45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058455:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058462:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058467:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058472:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.058475:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058481:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058487:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185ac100) 00010000:00010000:3.0:1777580310.058490:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.058503:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058508:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e49d4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058548:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49d3e lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e151 expref: 435 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058560:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.058562:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.058566:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e49d3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e151 expref: 435 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058576:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:3.0:1777580310.058659:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:282951:x1863919946589696:12345-192.168.202.9@tcp:101:rm.500 Request processed in 645us (1139us total) trans 0 rc 301/301 00000100:00100000:3.0:1777580310.058668:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19299 00000100:00100000:3.0:1777580310.058698:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831006963937 time 7831007560663 state 0x0 ref 2 00000100:00100000:3.0:1777580310.058711:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+433:282966:x1863919946589824:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.058720:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.058730:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49d53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e158 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058764:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058772:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058788:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058801:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058808:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058815:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058929:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058938:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.058945:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580310.058980:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7da:0x0]: returning size 0 00000004:00200000:3.0:1777580310.058984:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580310.059004:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059015:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059022:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059037:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059043:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059048:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.059050:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059057:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059065:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.059067:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.059070:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059075:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e49d5a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059086:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059091:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059097:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059102:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.059110:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059116:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059123:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024185ac900) 00010000:00010000:3.0:1777580310.059126:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.059128:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059160:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e49d61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059184:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e49d53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e158 expref: 435 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059198:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e158 expref: 434 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.059205:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa024acb37500) 00010000:00010000:3.0:1777580310.059207:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.059209:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee8600, rc 0) 00000100:00100000:3.0:1777580310.059239:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:282966:x1863919946589824:12345-192.168.202.9@tcp:101:rm.500 Request processed in 531us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.059246:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19300 00010000:00010000:2.0:1777580310.059688:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.059704:0:187630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.059712:0:187630:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.059733:0:187630:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.059745:0:187630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.060009:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.060103:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.061643:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.061693:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590080 00000100:00100000:2.0:1777580310.061706:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590080 00000100:00100000:2.0:1777580310.061763:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830982151955 time 7830982051955 state 0x1 ref 2 00000100:00100000:2.0:1777580310.061788:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590208 00000100:00100000:2.0:1777580310.061792:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590208 00000100:00100000:2.0:1777580310.061807:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831007660663 time 7831007560663 state 0x1 ref 2 00000100:00100000:2.0:1777580310.061834:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590336 00000100:00100000:2.0:1777580310.061837:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590336 00000100:00100000:2.0:1777580310.061860:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831007660663 time 7831007560663 state 0x1 ref 3 00000100:00100000:2.0:1777580310.061880:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830982151955 time 7831010742649 state 0x0 ref 2 00000100:00100000:2.0:1777580310.061892:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+436:282950:x1863919946590080:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580310.061969:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.062021:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e49d29 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e12e expref: 436 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.062044:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa024997a0b00) 00010000:00010000:2.0:1777580310.062056:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580310.062169:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.062185:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.062206:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.068120:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002dfdc8d3 reply state 000000003abf7984 transno 8589950578 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.068162:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.068335:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+437:282950:x1863919946590080:12345-192.168.202.9@tcp:36:touch.500 Request processed in 6438us (8322us total) trans 8589950578 rc 0/0 00000100:00100000:2.0:1777580310.068348:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19301 00000100:00100000:2.0:1777580310.068405:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831017364211 time 7831017264211 state 0x1 ref 3 00000100:00100000:2.0:1777580310.068423:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+436:282952:x1863919946590208:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.069079:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.069257:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831017364211 time 7831018116397 state 0x0 ref 3 00000100:00100000:3.0:1777580310.069278:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+436:282967:x1863919946590336:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.069309:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.069334:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49d7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e166 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069414:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069445:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069459:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069479:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069487:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069495:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069636:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069645:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069653:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580310.069682:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7db:0x0]: returning size 0 00000004:00200000:3.0:1777580310.069693:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580310.069719:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069735:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069744:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069751:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069759:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069766:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.069771:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069780:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069794:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.069798:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.069804:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.069811:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49d84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070013:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070032:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070039:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070044:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.070048:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070054:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070064:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02497a21a00) 00010000:00010000:3.0:1777580310.070067:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.070070:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070077:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49d8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070113:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49d7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e166 expref: 438 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070130:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e166 expref: 437 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.070169:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580310.070172:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.070184:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030200, rc 0) 00000100:00100000:3.0:1777580310.070250:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+437:282967:x1863919946590336:12345-192.168.202.9@tcp:101:rm.500 Request processed in 978us (8616us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.070259:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19303 00000100:00100000:1.0:1777580310.070602:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946589440 00000100:00100000:1.0:1777580310.070614:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946589440 00000100:00100000:1.0:1777580310.070671:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11783 00000100:00100000:1.0:1777580310.070682:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946589440:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.070694:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.070715:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e143 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580310.070744:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1598:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:1.0:1777580310.070763:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.070766:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.070775:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 45 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.070793:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 45 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.070806:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c200, rc 0) 00010000:00010000:2.0:1777580310.070978:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.070997:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49da0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e15f expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071051:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071064:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071074:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071089:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071111:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071120:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071253:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071262:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071270:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.071299:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d7:0x0]: returning size 0 00000004:00200000:2.0:1777580310.071302:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.071319:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071329:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071336:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071343:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071349:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071366:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.071369:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071376:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071387:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.071389:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.071393:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071399:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49da7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071413:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071420:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.071426:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.072040:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946589440:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1354us (17734us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.072062:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11783 00000100:00100000:3.0:1777580310.073300:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.073344:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590464 00000100:00100000:3.0:1777580310.073355:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590464 00000100:00100000:3.0:1777580310.073406:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831018216397 time 7831018116397 state 0x1 ref 3 00000100:00100000:3.0:1777580310.073526:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831018216397 time 7831022386654 state 0x0 ref 3 00000100:00100000:3.0:1777580310.073542:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+438:282964:x1863919946590464:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.073565:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.073589:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49dbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e16d expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073666:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073683:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073696:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073714:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073722:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.073746:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777580310.074578:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777580310.075239:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075260:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075273:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580310.075326:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7d9:0x0]: returning size 0 00000004:00200000:3.0:1777580310.075332:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580310.075361:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075378:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075390:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075398:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075406:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.075414:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.075418:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075587:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.075591:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075600:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075629:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0249881dd00) 00010000:00010000:2.0:1777580310.075633:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.075639:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075647:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49dae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075708:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49da0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e15f expref: 440 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075725:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e15f expref: 439 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.075735:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024acb37100) 00010000:00010000:2.0:1777580310.075738:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.075741:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b800, rc 0) 00010000:00010000:3.0:1777580310.076553:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076565:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.076568:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.076572:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076579:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49dc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076599:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076607:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076613:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076618:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.076620:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076627:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076636:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580310.076638:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.076641:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076656:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49dca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076694:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49dbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e16d expref: 440 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076711:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e16d expref: 439 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.076720:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa024acb37800) 00010000:00010000:3.0:1777580310.076722:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.076725:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd000, rc 0) 00000100:00100000:3.0:1777580310.076768:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:282964:x1863919946590464:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3228us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.076780:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19304 00000100:00100000:2.0:1777580310.076955:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+438:282952:x1863919946590208:12345-192.168.202.9@tcp:101:rm.500 Request processed in 8537us (16850us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.076963:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19302 00000100:00100000:2.0:1777580310.077175:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.077216:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.077246:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.077662:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.086237:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590592 00000100:00100000:2.0:1777580310.086258:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590592 00010000:00010000:2.0:1777580310.086322:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 152 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.086391:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4332 00000100:00100000:2.0:1777580310.086403:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:2363:x1863919946590592:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580310.086437:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.086447:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 152 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086463:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 152 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086491:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49cea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e135 expref: 152 pid: 187631 timeout: 7930 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086512:0:187615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.086517:0:187615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086527:0:187615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086536:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086544:0:187615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086553:0:187615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086570:0:187615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086600:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580310.086664:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:2363:x1863919946590592:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 264us (9490us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.086673:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4332 00000100:00100000:2.0:1777580310.086705:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590720 00000100:00100000:2.0:1777580310.086709:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590720 00000100:00100000:2.0:1777580310.086737:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831022486654 time 7831022386654 state 0x1 ref 2 00000100:00100000:2.0:1777580310.086760:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831022486654 time 7831035622674 state 0x0 ref 2 00000100:00100000:2.0:1777580310.086768:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+438:282968:x1863919946590720:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.086788:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.086806:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49dd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e174 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086903:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086916:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086924:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086943:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086957:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.086965:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087119:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087127:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087165:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.087200:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7dc:0x0]: returning size 0 00000004:00200000:2.0:1777580310.087205:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.087226:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087240:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087250:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087257:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087265:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087283:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.087288:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087296:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087306:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.087308:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.087313:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087320:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e49ddf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087333:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087339:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087345:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087349:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.087352:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087357:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087373:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa0249881d200) 00010000:00010000:2.0:1777580310.087376:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.087379:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087385:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49de6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087419:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49dd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e174 expref: 440 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087432:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e174 expref: 439 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.087440:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa024acb37900) 00010000:00010000:2.0:1777580310.087443:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.087445:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:2.0:1777580310.087486:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:282968:x1863919946590720:12345-192.168.202.9@tcp:101:rm.500 Request processed in 718us (10269us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.087495:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19305 00000100:00100000:2.0:1777580310.087532:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946590976 00000100:00100000:2.0:1777580310.087538:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946590976 00000100:00100000:2.0:1777580310.087575:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4140 00000100:00100000:2.0:1777580310.087583:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:282949:x1863919946590976:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580310.087906:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:282949:x1863919946590976:12345-192.168.202.9@tcp:35:touch.500 Request processed in 323us (10658us total) trans 8589950579 rc 0/0 00000100:00100000:2.0:1777580310.087925:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4140 00000100:00100000:2.0:1777580310.089056:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591104 00000100:00100000:2.0:1777580310.089068:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591104 00000100:00100000:2.0:1777580310.089164:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11784 00000100:00100000:2.0:1777580310.089174:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2361:x1863919946591104:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.089190:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.089216:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e17b expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580310.089248:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159c:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:2.0:1777580310.089272:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580310.089275:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580310.089285:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 35 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.089306:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 35 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.089320:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4c00, rc 0) 00000100:00100000:2.0:1777580310.089365:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2361:x1863919946591104:12345-192.168.202.9@tcp:101:rm.500 Request processed in 192us (11702us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.089372:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11784 00000100:00080000:1.0:1777580310.092210:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777580310.094219:0:188495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.094240:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097122:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097165:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097173:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097180:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.097186:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097195:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097230:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa0249881d600) 00010000:00010000:3.0:1777580310.097234:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.097240:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.097248:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49d76 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.098394:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.098937:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591232 00000100:00100000:3.0:1777580310.098953:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591232 00000100:00100000:3.0:1777580310.099024:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11785 00000100:00100000:3.0:1777580310.099035:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2362:x1863919946591232:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.099059:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.099089:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e182 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.099124:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15bf:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:3.0:1777580310.099177:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.099180:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.099190:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 39 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.099210:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 39 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.099225:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50200, rc 0) 00000100:00100000:3.0:1777580310.099314:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2362:x1863919946591232:12345-192.168.202.9@tcp:101:rm.500 Request processed in 280us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.099322:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11785 00000100:00100000:3.0:1777580310.099388:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:2.0:1777580310.099991:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ba1f1218 reply state 000000006bdc4ee5 transno 8589950580 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.100005:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.101147:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:282965:x1863919946588928:12345-192.168.202.9@tcp:36:touch.500 Request processed in 67919us (78503us total) trans 8589950580 rc 0/0 00000100:00100000:3.0:1777580310.101161:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19295 00000100:00100000:3.0:1777580310.101171:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830982151955 time 7831010742649 state 0x2 ref 0 00000100:00100000:3.0:1777580310.101205:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591488 00000100:00100000:3.0:1777580310.101213:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591488 00000100:00100000:3.0:1777580310.101247:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831035722674 time 7831035622674 state 0x1 ref 2 00000100:00100000:3.0:1777580310.101273:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831035722674 time 7831050135033 state 0x0 ref 2 00000100:00100000:3.0:1777580310.101285:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282928:x1863919946591488:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.101343:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.101375:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e49d0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e13c expref: 151 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.101398:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49709 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x803:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dfde expref: 150 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.101412:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02486090600) 00010000:00010000:3.0:1777580310.101425:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580310.101614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.101708:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.104798:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.104868:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.104884:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.104904:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.104911:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.104917:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105089:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105098:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105105:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.105749:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1849, 64 off126528 00010000:00010000:3.0:1777580310.105836:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105860:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105871:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105889:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105897:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105904:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105938:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.105971:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105977:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105984:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.105990:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.105994:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106003:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106017:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02497a21600) 00010000:00010000:3.0:1777580310.106021:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.106027:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106045:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49e10 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106069:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106076:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106082:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106087:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.106090:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106095:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106104:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.106106:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.106109:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106115:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e49e02 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.106125:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009e572a16 reply state 00000000599d72b9 transno 8589950581 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.106158:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.106286:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282928:x1863919946591488:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4997us (6891us total) trans 8589950581 rc 0/0 00000100:00100000:3.0:1777580310.106297:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19306 00000100:00100000:3.0:1777580310.106356:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591616 00000100:00100000:3.0:1777580310.106366:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591616 00000100:00100000:3.0:1777580310.106411:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591744 00000100:00100000:3.0:1777580310.106415:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591744 00000100:00100000:3.0:1777580310.106437:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11786 00000100:00100000:3.0:1777580310.106446:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2362:x1863919946591616:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.106465:0:188246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.106488:0:188246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e189 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.106517:0:188246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c1:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.106540:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.106543:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.106552:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 41 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106568:0:188246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 41 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106580:0:188246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51200, rc 0) 00000100:00100000:3.0:1777580310.106604:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2362:x1863919946591616:12345-192.168.202.9@tcp:101:rm.500 Request processed in 161us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.106611:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11786 00000100:00100000:3.0:1777580310.106624:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11787 00000100:00100000:3.0:1777580310.106638:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2363:x1863919946591744:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.106646:0:188246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.106658:0:188246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e190 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.106674:0:188246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c0:0x0] initial LVB size: 0, mtime: 0x69f3b914, atime: 0x69f3b914, ctime: 0x69f3b914, blocks: 0x1 00010000:00010000:3.0:1777580310.106683:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.106684:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.106688:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 41 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106699:0:188246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 41 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106708:0:188246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b638f400, rc 0) 00000100:00100000:3.0:1777580310.106729:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2363:x1863919946591744:12345-192.168.202.9@tcp:101:rm.500 Request processed in 92us (5020us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.106735:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11787 00010000:00010000:3.0:1777580310.106759:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.106766:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106773:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.106777:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106784:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106800:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x803:0x0].0x0 (ffffa02497a21600) 00010000:00010000:3.0:1777580310.106803:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.106806:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106813:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49e17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.106833:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.106835:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.106837:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580310.120254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.127479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.127512:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592000 00000100:00100000:2.0:1777580310.127524:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592000 00000100:00100000:2.0:1777580310.127571:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7830982151955 time 7831010742649 state 0x0 ref 1 00000100:00100000:2.0:1777580310.127583:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831010842649 time 7831010742649 state 0x1 ref 1 00000100:00100000:2.0:1777580310.127609:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831010842649 time 7831076470641 state 0x0 ref 1 00000100:00100000:2.0:1777580310.127618:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:282965:x1863919946592000:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.127650:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.127674:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032c00/0xcb2b2f2f7e49e2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e19e expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.127743:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032c00/0xcb2b2f2f7e49e2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e19e expref: 441 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.127757:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032c00/0xcb2b2f2f7e49e2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e19e expref: 441 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.127795:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.127797:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580310.127800:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248c032c00, rc 0) 00010000:00010000:0.0:1777580310.128031:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128042:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128050:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128058:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.128071:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128081:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128096:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:0.0:1777580310.128099:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.128102:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128113:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128122:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128193:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.128201:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49d14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.128358:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:282965:x1863919946592000:12345-192.168.202.9@tcp:101:touch.500 Request processed in 737us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.128368:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19307 00000100:00100000:2.0:1777580310.128375:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831010842649 time 7831076470641 state 0x2 ref 0 00010000:00010000:2.0:1777580310.128504:0:187630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.128513:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.128562:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x804:0x0]: returning size 0 00000004:00200000:2.0:1777580310.128567:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.128593:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.128606:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.128643:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49d37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e14a expref: 151 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.128658:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e14a expref: 150 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.128681:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.128683:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.128686:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8aa00, rc 0) 00000100:00100000:2.0:1777580310.128714:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282930:x1863919946589568:12345-192.168.202.9@tcp:101:rm.500 Request processed in 70961us (71241us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.128722:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19298 00000100:00100000:2.0:1777580310.128727:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831035722674 time 7831050135033 state 0x2 ref 0 00000100:00100000:2.0:1777580310.128795:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.128942:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592256 00000100:00100000:2.0:1777580310.128949:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592256 00000100:00100000:2.0:1777580310.128974:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831010842649 time 7831076470641 state 0x0 ref 1 00000100:00100000:2.0:1777580310.128984:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831076570641 time 7831076470641 state 0x1 ref 1 00000100:00100000:2.0:1777580310.129061:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831076570641 time 7831077923484 state 0x0 ref 1 00000100:00100000:2.0:1777580310.129073:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:282953:x1863919946592256:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.129093:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.129110:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49e33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1a5 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129304:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129316:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129338:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129356:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129364:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.129372:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580310.130129:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c3:0x0], index 0: 0 00010000:00010000:2.0:1777580310.130390:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49e48 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130406:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49e48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130418:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49e48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130464:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130471:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130479:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130486:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.130498:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130507:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130522:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.130526:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.130530:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130539:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49e3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.130554:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f7b90605 reply state 00000000200544e5 transno 8589950582 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.130564:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580310.130601:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49e33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1a5 expref: 443 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130617:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49e48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1a5 expref: 442 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.130626:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:2.0:1777580310.130628:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.130631:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9bc00, rc 0) 00000100:00100000:2.0:1777580310.130705:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+443:282953:x1863919946592256:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1633us (1909us total) trans 8589950582 rc 0/0 00000100:00100000:2.0:1777580310.130715:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19308 00000100:00100000:2.0:1777580310.130728:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831076570641 time 7831077923484 state 0x2 ref 0 00000100:00100000:2.0:1777580310.131279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.131311:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592384 00000100:00100000:2.0:1777580310.131321:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592384 00000100:00100000:2.0:1777580310.131353:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831076570641 time 7831077923484 state 0x0 ref 1 00000100:00100000:2.0:1777580310.131365:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831078023484 time 7831077923484 state 0x1 ref 1 00000100:00100000:2.0:1777580310.131390:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831078023484 time 7831080252380 state 0x0 ref 1 00000100:00100000:2.0:1777580310.131401:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+443:282950:x1863919946592384:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.131423:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.131520:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49e56 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1ac expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.131578:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49e56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ac expref: 444 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.131592:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49e56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ac expref: 444 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.131611:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa024997a0b00) 00010000:00010000:2.0:1777580310.131614:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580310.131617:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:2.0:1777580310.131655:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+444:282950:x1863919946592384:12345-192.168.202.9@tcp:101:touch.500 Request processed in 256us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.131663:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19309 00000100:00100000:2.0:1777580310.131677:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831078023484 time 7831080252380 state 0x2 ref 0 00000100:00100000:1.0:1777580310.132203:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946591872 00000100:00100000:1.0:1777580310.132211:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946591872 00000100:00100000:1.0:1777580310.135026:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11788 00000100:00100000:1.0:1777580310.135060:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2364:x1863919946591872:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.135089:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.135126:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e197 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580310.135182:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159d:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:1.0:1777580310.135211:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.135214:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.135226:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 36 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.135249:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 36 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.135266:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c400, rc 0) 00000100:00100000:1.0:1777580310.135348:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2364:x1863919946591872:12345-192.168.202.9@tcp:101:rm.500 Request processed in 308us (15108us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.135356:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11788 00010000:00010000:3.0:1777580310.139929:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.139954:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.139963:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.139970:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.139976:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.139984:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.140005:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02497a21f00) 00010000:00010000:3.0:1777580310.140009:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.140015:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.140044:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49e09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155620:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155661:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155672:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155680:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.155686:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155697:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155721:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0249881d200) 00010000:00010000:1.0:1777580310.155725:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.155731:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.155738:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49e41 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.160271:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.160318:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.160354:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592640 00000100:00100000:3.0:1777580310.160367:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592640 00000100:00100000:3.0:1777580310.160426:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592512 00000100:00100000:3.0:1777580310.160504:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592512 00000100:00100000:3.0:1777580310.160547:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11789 00000100:00100000:3.0:1777580310.160558:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2364:x1863919946592640:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580310.161006:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11790 00000100:00100000:1.0:1777580310.161018:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2361:x1863919946592512:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580310.161342:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2361:x1863919946592512:12345-192.168.202.9@tcp:2:touch.500 Request processed in 327us (1022us total) trans 8589938556 rc 0/0 00000100:00100000:1.0:1777580310.161351:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11790 00000100:00100000:1.0:1777580310.161752:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.162672:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2364:x1863919946592640:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2111us (2412us total) trans 8589938956 rc 0/0 00000100:00100000:3.0:1777580310.162683:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11789 00000100:00100000:3.0:1777580310.162710:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946592768 00000100:00100000:3.0:1777580310.162720:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946592768 00000100:00100000:3.0:1777580310.162788:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11791 00000100:00100000:3.0:1777580310.162798:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946592768:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.162815:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.165156:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1b3 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.165208:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15be:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.165238:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.165240:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.165257:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 45 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.165290:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 45 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.165309:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9ae00, rc 0) 00000100:00100000:3.0:1777580310.165404:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946592768:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2606us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.165414:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11791 00000100:00080000:1.0:1777580310.166650:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777580310.169408:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.169461:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.169492:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946593024 00000100:00100000:2.0:1777580310.169504:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946593024 00000100:00100000:2.0:1777580310.169552:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831078023484 time 7831080252380 state 0x0 ref 1 00000100:00100000:2.0:1777580310.169568:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831080352380 time 7831080252380 state 0x1 ref 1 00000100:00100000:2.0:1777580310.169587:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946593280 00000100:00100000:2.0:1777580310.169590:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946593280 00000100:00100000:2.0:1777580310.169603:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831080352380 time 7831080252380 state 0x1 ref 2 00000100:00100000:2.0:1777580310.169622:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831118584378 time 7831118484378 state 0x1 ref 2 00000100:00100000:2.0:1777580310.169634:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+444:282953:x1863919946593024:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580310.169712:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.169746:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e49e48 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1a5 expref: 444 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.169770:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa0249881dd00) 00010000:00010000:2.0:1777580310.169784:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580310.169908:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.169924:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.169935:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.170129:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006fa9f74e reply state 00000000e446a4e8 transno 8589950583 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.170171:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.170287:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+445:282953:x1863919946593024:12345-192.168.202.9@tcp:36:touch.500 Request processed in 654us (891us total) trans 8589950583 rc 0/0 00000100:00100000:2.0:1777580310.170296:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19310 00000100:00100000:2.0:1777580310.170319:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831118584378 time 7831119182303 state 0x0 ref 1 00000100:00100000:2.0:1777580310.170330:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+444:282955:x1863919946593280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.170341:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.170354:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49e72 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1ba expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170476:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170488:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170497:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170513:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170520:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.170541:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580310.171099:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159f:0x0], index 1: 0 00010000:00010000:2.0:1777580310.171326:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49e87 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171339:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49e87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171347:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49e87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171385:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171392:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171400:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171407:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.171411:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171419:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171430:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.171434:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.171446:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171453:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49e79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.171466:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000089ddf571 reply state 00000000913cc2c0 transno 8589950584 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.171476:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580310.171511:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49e72 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ba expref: 447 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171525:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49e87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ba expref: 446 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.171532:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:2.0:1777580310.171535:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.171538:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:2.0:1777580310.171594:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+447:282955:x1863919946593280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1266us (2133us total) trans 8589950584 rc 0/0 00000100:00100000:2.0:1777580310.171603:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19311 00000100:00100000:2.0:1777580310.171609:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831118584378 time 7831119182303 state 0x2 ref 0 00000100:00100000:2.0:1777580310.171772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.172194:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946593536 00000100:00100000:1.0:1777580310.172205:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946593536 00000100:00100000:1.0:1777580310.172258:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4141 00000100:00100000:1.0:1777580310.172269:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+447:282950:x1863919946593536:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580310.172622:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:282950:x1863919946593536:12345-192.168.202.9@tcp:35:touch.500 Request processed in 354us (849us total) trans 8589950585 rc 0/0 00000100:00100000:1.0:1777580310.172632:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4141 00010000:00010000:3.0:1777580310.181702:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181727:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181735:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181743:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.181748:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181757:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181780:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02498a66600) 00010000:00010000:3.0:1777580310.181783:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.181789:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.181816:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49e6b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.187598:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580310.192627:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192653:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192663:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192671:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.192677:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192686:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192709:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024185aa300) 00010000:00010000:1.0:1777580310.192713:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.192720:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.192727:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49e80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.193130:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.193183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.193199:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.193306:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.193630:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946593792 00000100:00100000:1.0:1777580310.193643:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946593792 00000100:00100000:1.0:1777580310.193689:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831118584378 time 7831119182303 state 0x0 ref 1 00000100:00100000:1.0:1777580310.193703:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831119282303 time 7831119182303 state 0x1 ref 1 00000100:00100000:1.0:1777580310.193725:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946593920 00000100:00100000:1.0:1777580310.193727:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946593920 00000100:00100000:1.0:1777580310.193737:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831119282303 time 7831119182303 state 0x1 ref 2 00000100:00100000:1.0:1777580310.193750:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946594176 00000100:00100000:1.0:1777580310.193752:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946594176 00000100:00100000:1.0:1777580310.193761:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831119282303 time 7831119182303 state 0x1 ref 3 00000100:00100000:1.0:1777580310.193771:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946594304 00000100:00100000:1.0:1777580310.193773:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946594304 00000100:00100000:1.0:1777580310.193782:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831035722674 time 7831050135033 state 0x0 ref 1 00000100:00100000:1.0:1777580310.193788:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831050235033 time 7831050135033 state 0x1 ref 1 00000100:00100000:1.0:1777580310.193805:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831050235033 time 7831142666704 state 0x0 ref 1 00000100:00100000:1.0:1777580310.193826:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282930:x1863919946594304:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.193868:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.193891:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e49e95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1cf expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.193973:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194006:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194019:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194035:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194043:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194049:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194206:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194215:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194222:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580310.194255:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x804:0x0]: returning size 0 00000004:00200000:1.0:1777580310.194259:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580310.194285:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194298:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194318:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194325:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194330:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194337:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.194340:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194347:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194359:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.194362:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.194366:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194373:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e49e9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194387:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194393:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194398:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194409:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.194412:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194417:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194435:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0249881d200) 00010000:00010000:1.0:1777580310.194438:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.194441:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194448:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e49ea3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194486:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e49e95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 151 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194500:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 150 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194507:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:1.0:1777580310.194510:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580310.194513:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1d400, rc 0) 00000100:00100000:1.0:1777580310.194594:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282930:x1863919946594304:12345-192.168.202.9@tcp:101:rm.500 Request processed in 779us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.194604:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19315 00000100:00100000:1.0:1777580310.194609:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831050235033 time 7831142666704 state 0x2 ref 0 00000100:00100000:1.0:1777580310.194777:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831143739262 time 7831143639262 state 0x1 ref 3 00000100:00100000:1.0:1777580310.194793:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:282955:x1863919946593792:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580310.194834:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580310.194866:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49e87 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ba expref: 448 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194880:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580310.194888:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580310.194961:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194971:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.194979:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.195176:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000670f5638 reply state 000000002769214a transno 8589950586 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.195186:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580310.195255:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+449:282955:x1863919946593792:12345-192.168.202.9@tcp:36:touch.500 Request processed in 466us (7673us total) trans 8589950586 rc 0/0 00000100:00100000:1.0:1777580310.195262:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19312 00000100:00100000:1.0:1777580310.195281:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144244062 time 7831144144062 state 0x1 ref 2 00000100:00100000:1.0:1777580310.195291:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:282953:x1863919946593920:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.195313:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.195326:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e49eb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1c1 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.195361:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e49eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c1 expref: 449 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.195372:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e49eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c1 expref: 449 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.195390:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02499479b00) 00010000:00010000:1.0:1777580310.195392:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580310.195395:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1cc00, rc 0) 00000100:00100000:1.0:1777580310.195415:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+449:282953:x1863919946593920:12345-192.168.202.9@tcp:101:touch.500 Request processed in 126us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.195422:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19313 00000100:00100000:1.0:1777580310.195437:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144244062 time 7831144300875 state 0x0 ref 1 00000100:00100000:1.0:1777580310.195447:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:282961:x1863919946594176:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.195455:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.195464:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ebf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1c8 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196736:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196759:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196784:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196803:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196810:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.196817:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.198255:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.198313:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946594944 00000100:00100000:3.0:1777580310.198326:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946594944 00000100:00100000:3.0:1777580310.198371:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831050235033 time 7831142666704 state 0x0 ref 1 00000100:00100000:3.0:1777580310.198387:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831142766704 time 7831142666704 state 0x1 ref 1 00000100:00100000:3.0:1777580310.198411:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831142766704 time 7831147274361 state 0x0 ref 1 00000100:00100000:3.0:1777580310.198422:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282930:x1863919946594944:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.198570:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.198600:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49d6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e14a expref: 150 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198626:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4981a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x804:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e024 expref: 149 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198640:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:3.0:1777580310.198645:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.198683:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198696:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198706:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198720:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198727:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.198733:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.202800:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.202846:0:187631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 148 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.202868:0:187631:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.202933:0:187631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 148 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.202953:0:187631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 148 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.202987:0:187631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917458816:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580310.203104:0:187631:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024c2c786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580310.203303:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.205109:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205129:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205160:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205167:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1de00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.205173:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205182:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205203:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02490544200) 00010000:00010000:3.0:1777580310.205207:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.205213:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.205221:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1de00/0xcb2b2f2f7e49eb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580310.205599:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c4:0x0], index 0: 0 00010000:00010000:1.0:1777580310.205913:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49ee9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.205931:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.205944:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.205997:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206005:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206012:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206018:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.206038:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206045:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206057:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.206060:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.206063:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206070:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49ec6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.206085:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000b57f9ea reply state 0000000072be9891 transno 8589950587 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.206096:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580310.206186:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e49ebf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c8 expref: 450 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206204:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c8 expref: 449 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.206211:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02417834f00) 00010000:00010000:1.0:1777580310.206214:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580310.206216:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838400, rc 0) 00000100:00100000:1.0:1777580310.206312:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+450:282961:x1863919946594176:12345-192.168.202.9@tcp:101:touch.500 Request processed in 10864us (13127us total) trans 8589950587 rc 0/0 00000100:00100000:1.0:1777580310.206323:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19314 00000100:00100000:1.0:1777580310.206343:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144244062 time 7831144300875 state 0x2 ref 0 00000100:00100000:1.0:1777580310.208030:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946594560 00000100:00100000:1.0:1777580310.208048:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946594560 00000100:00100000:1.0:1777580310.208116:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4142 00000100:00100000:1.0:1777580310.208128:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+450:282965:x1863919946594560:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580310.208691:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946594688 00000100:00100000:2.0:1777580310.208700:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946594688 00010000:00010000:2.0:1777580310.208733:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 149 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.208793:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4333 00000100:00100000:2.0:1777580310.208801:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:2363:x1863919946594688:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580310.208814:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.208965:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 149 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.208982:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 149 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.209009:0:189815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.209016:0:189815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.209028:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.209036:0:189815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.209062:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580310.209131:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:2363:x1863919946594688:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 330us (5828us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.209165:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4333 00000100:00100000:1.0:1777580310.209705:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+451:282965:x1863919946594560:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1577us (16395us total) trans 8589950588 rc 0/0 00000100:00100000:1.0:1777580310.209713:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4142 00010000:00010000:1.0:1777580310.209804:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.209816:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.212400:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.212409:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.212416:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.212938:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.212967:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02499479000) 00010000:00010000:1.0:1777580310.212971:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.212978:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.212999:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49ecd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.220655:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.220774:0:187631:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.9@tcp) returned -22 from blocking AST (req@000000008570e379 x1863919917458816) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 148 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.220834:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d400/0xcb2b2f2f7e49eaa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1cf expref: 148 pid: 205914 timeout: 7931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.220869:0:187631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917458816:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580310.220904:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:3.0:1777580310.220916:0:187631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.220928:0:187631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.220935:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.221668:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1853, 64 off126784 00010000:00010000:3.0:1777580310.221759:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221778:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221791:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221799:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221805:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221818:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221861:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.221891:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221898:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221905:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221911:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.221916:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221925:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221936:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:3.0:1777580310.221939:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.221943:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221949:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49ee2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x804:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221970:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221986:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221993:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.221998:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.222001:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222006:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222014:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.222016:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.222019:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222024:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e49ed4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.222034:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b16e7e46 reply state 0000000044d34c36 transno 8589950589 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.222043:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.222182:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:282930:x1863919946594944:12345-192.168.202.9@tcp:36:rm.500 Request processed in 23757us (23933us total) trans 8589950589 rc 0/0 00000100:00100000:3.0:1777580310.222193:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19316 00000100:00100000:3.0:1777580310.222204:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831142766704 time 7831147274361 state 0x2 ref 0 00000100:00100000:3.0:1777580310.222251:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595072 00000100:00100000:3.0:1777580310.222259:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595072 00000100:00100000:3.0:1777580310.222290:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144244062 time 7831144300875 state 0x0 ref 1 00000100:00100000:3.0:1777580310.222302:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144400875 time 7831144300875 state 0x1 ref 1 00000100:00100000:3.0:1777580310.222326:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144400875 time 7831171188245 state 0x0 ref 1 00000100:00100000:3.0:1777580310.222337:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+450:282955:x1863919946595072:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.222362:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.222381:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49efe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1d6 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222439:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49efe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1d6 expref: 451 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222452:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49efe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1d6 expref: 451 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222472:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02497a21b00) 00010000:00010000:3.0:1777580310.222475:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580310.222478:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51c00, rc 0) 00000100:00100000:3.0:1777580310.222499:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+451:282955:x1863919946595072:12345-192.168.202.9@tcp:101:touch.500 Request processed in 165us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.222505:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19317 00000100:00100000:3.0:1777580310.222509:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144400875 time 7831171188245 state 0x2 ref 0 00000100:00100000:3.0:1777580310.222583:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.222680:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.222786:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.222807:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595328 00000100:00100000:3.0:1777580310.222812:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595328 00000100:00100000:3.0:1777580310.222828:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831144400875 time 7831171188245 state 0x0 ref 1 00000100:00100000:3.0:1777580310.222836:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171288245 time 7831171188245 state 0x1 ref 1 00000100:00100000:3.0:1777580310.222862:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595712 00000100:00100000:3.0:1777580310.222865:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595712 00000100:00100000:3.0:1777580310.222875:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171288245 time 7831171188245 state 0x1 ref 2 00000100:00100000:3.0:1777580310.222891:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171854375 time 7831171754375 state 0x1 ref 2 00000100:00100000:3.0:1777580310.222900:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02484c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+452:282961:x1863919946595328:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580310.222946:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580310.222967:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e49ee9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c8 expref: 452 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.222982:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580310.222992:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.223070:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223080:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223090:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.223284:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a208d160 reply state 00000000ddd45532 transno 8589950590 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.223294:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.223373:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02484c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+453:282961:x1863919946595328:12345-192.168.202.9@tcp:36:touch.500 Request processed in 473us (789us total) trans 8589950590 rc 0/0 00000100:00100000:3.0:1777580310.223381:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19318 00000100:00100000:3.0:1777580310.223403:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171854375 time 7831172266291 state 0x0 ref 1 00000100:00100000:3.0:1777580310.223415:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+452:282962:x1863919946595712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.223425:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.223437:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49f0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1dd expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223551:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223564:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223572:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223589:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223596:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.223615:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.224196:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595456 00000100:00100000:1.0:1777580310.224206:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595456 00000100:00100000:1.0:1777580310.224260:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11792 00000100:00100000:1.0:1777580310.224269:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2363:x1863919946595456:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580310.224588:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+43:2363:x1863919946595456:12345-192.168.202.9@tcp:2:touch.500 Request processed in 320us (1907us total) trans 8589938957 rc 0/0 00000100:00100000:1.0:1777580310.224597:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11792 00010000:00010000:2.0:1777580310.226991:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580310.227013:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.227059:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580310.227065:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.227078:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.227105:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x804:0x0].0x0 (ffffa024993dfb00) 00010000:00010000:2.0:1777580310.227109:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580310.227115:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.227122:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e49ef7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.227318:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580310.227320:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580310.227322:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580310.235017:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a0:0x0], index 1: 0 00010000:00010000:3.0:1777580310.235328:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49f21 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235350:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49f21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235364:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49f21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235408:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235416:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235422:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235427:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.235432:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235439:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235453:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.235456:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.235471:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235478:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e49f13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.235493:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000054050ccf reply state 00000000638d730a transno 8589950591 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.235503:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580310.235547:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49f0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1dd expref: 455 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235564:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49f21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1dd expref: 454 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.235572:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa02490544200) 00010000:00010000:3.0:1777580310.235575:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.235577:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030a00, rc 0) 00000100:00100000:3.0:1777580310.235669:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+455:282962:x1863919946595712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12254us (12880us total) trans 8589950591 rc 0/0 00000100:00100000:3.0:1777580310.235679:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19319 00000100:00100000:3.0:1777580310.235689:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171854375 time 7831172266291 state 0x2 ref 0 00010000:00010000:3.0:1777580310.236457:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236471:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236477:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236494:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.236498:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236505:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236518:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02497a21600) 00010000:00010000:3.0:1777580310.236521:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.236525:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.236531:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49edb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.237063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.240034:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595840 00000100:00100000:1.0:1777580310.240052:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595840 00000100:00100000:3.0:1777580310.240267:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11793 00000100:00100000:3.0:1777580310.240279:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2363:x1863919946595840:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.242381:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2363:x1863919946595840:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2089us (5309us total) trans 8589938557 rc 0/0 00000100:00100000:3.0:1777580310.242394:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11793 00010000:00010000:1.0:1777580310.246870:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246891:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246900:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246906:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.246913:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246921:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246941:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02497a21a00) 00010000:00010000:1.0:1777580310.246960:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.246966:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.246973:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49f05 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.250196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.250251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.250280:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.250306:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.250785:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946595968 00000100:00100000:1.0:1777580310.250800:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946595968 00000100:00100000:1.0:1777580310.250878:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831171854375 time 7831172266291 state 0x0 ref 1 00000100:00100000:1.0:1777580310.250895:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831172366291 time 7831172266291 state 0x1 ref 1 00000100:00100000:1.0:1777580310.250919:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946596480 00000100:00100000:1.0:1777580310.250922:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946596480 00000100:00100000:1.0:1777580310.250936:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831172366291 time 7831172266291 state 0x1 ref 2 00000100:00100000:1.0:1777580310.250950:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946596736 00000100:00100000:1.0:1777580310.250953:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946596736 00000100:00100000:1.0:1777580310.250964:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831172366291 time 7831172266291 state 0x1 ref 3 00000100:00100000:1.0:1777580310.250984:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831199945915 time 7831199845915 state 0x1 ref 3 00000100:00100000:1.0:1777580310.250998:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:282961:x1863919946595968:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.251029:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.251063:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49f2f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1e4 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251166:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49f2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1e4 expref: 457 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251208:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49f2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1e4 expref: 457 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251234:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02417834e00) 00010000:00010000:1.0:1777580310.251238:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580310.251242:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839a00, rc 0) 00000100:00100000:1.0:1777580310.251334:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:282961:x1863919946595968:12345-192.168.202.9@tcp:101:touch.500 Request processed in 338us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.251343:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19320 00000100:00100000:1.0:1777580310.251367:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200329822 time 7831200229822 state 0x1 ref 2 00000100:00100000:1.0:1777580310.251377:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:282962:x1863919946596480:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580310.251427:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580310.251450:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49f21 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1dd expref: 456 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251469:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa02490544200) 00010000:00010000:1.0:1777580310.251479:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580310.251552:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251563:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.251572:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.251760:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4905328 reply state 000000005d33f3e6 transno 8589950592 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.251770:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580310.251837:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:282962:x1863919946596480:12345-192.168.202.9@tcp:36:touch.500 Request processed in 460us (1555us total) trans 8589950592 rc 0/0 00000100:00100000:1.0:1777580310.251845:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19321 00000100:00100000:1.0:1777580310.251880:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200329822 time 7831200742655 state 0x0 ref 1 00000100:00100000:1.0:1777580310.251891:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:282960:x1863919946596736:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.251901:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.251912:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49f3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1eb expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252029:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252042:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252051:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252066:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252073:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252092:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580310.252681:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c5:0x0], index 0: 0 00010000:00010000:1.0:1777580310.252888:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e49f52 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252900:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e49f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252908:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e49f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252947:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252955:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252963:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252969:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.252973:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252983:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.252995:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.252998:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.253009:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.253015:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e49f44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.253030:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b04bb781 reply state 00000000ddc63a36 transno 8589950593 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.253038:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580310.253072:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e49f3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1eb expref: 459 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.253086:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e49f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1eb expref: 458 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.253094:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa02483f8ef00) 00010000:00010000:1.0:1777580310.253096:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580310.253099:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838800, rc 0) 00000100:00100000:1.0:1777580310.253196:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282960:x1863919946596736:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1305us (2888us total) trans 8589950593 rc 0/0 00000100:00100000:1.0:1777580310.253205:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19322 00000100:00100000:1.0:1777580310.253212:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200329822 time 7831200742655 state 0x2 ref 0 00000100:00100000:1.0:1777580310.253268:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946596224 00000100:00100000:1.0:1777580310.253276:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946596224 00000100:00100000:1.0:1777580310.253333:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4143 00000100:00100000:1.0:1777580310.253341:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282953:x1863919946596224:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580310.253559:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282953:x1863919946596224:12345-192.168.202.9@tcp:35:touch.500 Request processed in 218us (3306us total) trans 8589950594 rc 0/0 00000100:00100000:1.0:1777580310.253577:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4143 00000100:00100000:3.0:1777580310.254582:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.254625:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254644:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254651:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254657:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.254662:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254670:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254684:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02498a66600) 00010000:00010000:3.0:1777580310.254686:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.254690:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.254696:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f1a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.263078:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946596992 00000100:00100000:1.0:1777580310.263098:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946596992 00000100:00100000:1.0:1777580310.263203:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4144 00000100:00100000:1.0:1777580310.263215:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282955:x1863919946596992:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580310.268190:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282955:x1863919946596992:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4957us (13592us total) trans 8589950595 rc 0/0 00000100:00100000:1.0:1777580310.268209:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4144 00000100:00100000:1.0:1777580310.288003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.288048:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.288071:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.288098:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580310.288166:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288180:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288187:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288193:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.288200:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288208:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288252:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02499479000) 00010000:00010000:1.0:1777580310.288256:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.288262:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288269:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e49f4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.288326:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946597248 00000100:00100000:1.0:1777580310.288340:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946597248 00000100:00100000:1.0:1777580310.288385:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200329822 time 7831200742655 state 0x0 ref 1 00000100:00100000:1.0:1777580310.288400:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200842655 time 7831200742655 state 0x1 ref 1 00000100:00100000:1.0:1777580310.288419:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946597504 00000100:00100000:1.0:1777580310.288422:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946597504 00000100:00100000:1.0:1777580310.288520:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831200842655 time 7831200742655 state 0x1 ref 2 00000100:00100000:1.0:1777580310.288537:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946597760 00000100:00100000:1.0:1777580310.288540:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946597760 00000100:00100000:1.0:1777580310.288551:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831142766704 time 7831147274361 state 0x0 ref 1 00000100:00100000:1.0:1777580310.288557:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831147374361 time 7831147274361 state 0x1 ref 1 00000100:00100000:1.0:1777580310.288577:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831147374361 time 7831237438690 state 0x0 ref 1 00000100:00100000:1.0:1777580310.288591:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282959:x1863919946597760:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580310.288673:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580310.288695:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e49c2d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e104 expref: 461 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288725:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e49af2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0d3 expref: 460 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288739:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:1.0:1777580310.288748:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580310.288778:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288795:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.288807:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.290173:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831239124804 time 7831239024804 state 0x1 ref 2 00000100:00100000:2.0:1777580310.290210:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282960:x1863919946597248:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580310.290277:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.290306:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e49f52 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1eb expref: 459 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.290329:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa02483f8ef00) 00010000:00010000:2.0:1777580310.290342:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580310.290551:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.290567:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.290579:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.290737:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.290745:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.290752:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291025:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291034:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291042:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291049:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.291062:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291070:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291080:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580310.291083:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.291086:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.291092:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e49f36 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.291201:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946597376 00000100:00100000:3.0:1777580310.291212:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946597376 00000100:00100000:3.0:1777580310.291267:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11794 00000100:00100000:3.0:1777580310.291277:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+43:2361:x1863919946597376:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.292207:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+44:2361:x1863919946597376:12345-192.168.202.9@tcp:2:touch.500 Request processed in 926us (4153us total) trans 8589938958 rc 0/0 00000100:00100000:3.0:1777580310.292218:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11794 00010000:00010000:2.0:1777580310.292555:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.292581:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.292596:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.292724:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bb10f19a reply state 0000000019c488a2 transno 8589950596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.292735:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.292810:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282960:x1863919946597248:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2616us (4821us total) trans 8589950596 rc 0/0 00000100:00100000:2.0:1777580310.293951:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19323 00000100:00100000:2.0:1777580310.294005:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831239124804 time 7831242864586 state 0x0 ref 1 00000100:00100000:2.0:1777580310.294024:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:282962:x1863919946597504:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.294047:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.294073:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49f7c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1f2 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.294149:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49f7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f2 expref: 459 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.294163:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49f7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f2 expref: 459 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.294185:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:2.0:1777580310.294196:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580310.294201:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248c032800, rc 0) 00000100:00100000:2.0:1777580310.294254:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282962:x1863919946597504:12345-192.168.202.9@tcp:101:touch.500 Request processed in 237us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.294260:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19324 00000100:00100000:2.0:1777580310.294264:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831239124804 time 7831242864586 state 0x2 ref 0 00000040:00080000:1.0:1777580310.294669:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1850, 64 off126592 00000004:00080000:1.0:1777580310.294678:0:187630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7831243543158ns, next at 7832243540236ns, rc = 0 00010000:00010000:1.0:1777580310.294758:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.294769:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.294779:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.294788:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.294794:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.294801:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.297962:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580310.298019:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298033:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298040:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298045:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.298070:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298080:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298101:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02483f8e700) 00010000:00010000:1.0:1777580310.298105:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580310.298109:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298116:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e49f6e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298167:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298175:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298181:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298186:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.298189:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298195:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298204:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.298206:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.298216:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.298223:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e49f60 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.298236:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000088e64e5e reply state 0000000008b3fa46 transno 8589950597 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.298247:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580310.299180:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580310.299191:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.299202:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580310.299206:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.299214:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.299229:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d8:0x0].0x0 (ffffa02483f8e700) 00010000:00010000:2.0:1777580310.299232:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580310.299235:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.299241:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e49f83 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.299267:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580310.299270:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580310.299271:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.299646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.301128:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282959:x1863919946597760:12345-192.168.202.9@tcp:36:rm.500 Request processed in 12528us (13016us total) trans 8589950597 rc 0/0 00000100:00100000:1.0:1777580310.301157:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19325 00000100:00100000:1.0:1777580310.301167:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831147374361 time 7831237438690 state 0x2 ref 0 00000100:00100000:3.0:1777580310.301786:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.301840:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.301887:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301899:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301921:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301927:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.301933:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301941:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301961:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa024185aa000) 00010000:00010000:3.0:1777580310.301964:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.301970:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.301977:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49f75 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.302018:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598144 00000100:00100000:3.0:1777580310.302029:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598144 00000100:00100000:3.0:1777580310.302066:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831239124804 time 7831242864586 state 0x0 ref 1 00000100:00100000:3.0:1777580310.302079:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831242964586 time 7831242864586 state 0x1 ref 1 00000100:00100000:3.0:1777580310.302103:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831242964586 time 7831250965699 state 0x0 ref 1 00000100:00100000:3.0:1777580310.302115:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:282960:x1863919946598144:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.302172:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.302194:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f8a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e1f9 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.302274:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f9 expref: 460 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.303624:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f9 expref: 460 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.303667:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa024185ac100) 00010000:00010000:3.0:1777580310.303671:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580310.303674:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031c00, rc 0) 00000100:00100000:3.0:1777580310.303757:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282960:x1863919946598144:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1643us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.303768:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19326 00000100:00100000:3.0:1777580310.303776:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831242964586 time 7831250965699 state 0x2 ref 0 00000100:00100000:3.0:1777580310.303922:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598272 00000100:00100000:3.0:1777580310.303930:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598272 00000100:00100000:3.0:1777580310.303973:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11795 00000100:00100000:3.0:1777580310.303981:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2361:x1863919946598272:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.307628:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2361:x1863919946598272:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3631us (5771us total) trans 8589938558 rc 0/0 00000100:00100000:3.0:1777580310.307647:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11795 00000100:00100000:2.0:1777580310.307983:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598016 00000100:00100000:2.0:1777580310.307994:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598016 00000100:00100000:2.0:1777580310.308062:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4145 00000100:00100000:2.0:1777580310.308070:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282961:x1863919946598016:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580310.309599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.310193:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282961:x1863919946598016:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2119us (10549us total) trans 8589950598 rc 0/0 00000100:00100000:2.0:1777580310.310207:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4145 00000100:00100000:2.0:1777580310.310278:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598400 00000100:00100000:2.0:1777580310.310288:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598400 00000100:00100000:2.0:1777580310.310324:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831147374361 time 7831237438690 state 0x0 ref 1 00000100:00100000:2.0:1777580310.310338:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831237538690 time 7831237438690 state 0x1 ref 1 00000100:00100000:2.0:1777580310.310368:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831237538690 time 7831259229667 state 0x0 ref 1 00000100:00100000:2.0:1777580310.310380:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282951:x1863919946598400:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.310405:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.310580:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310594:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310603:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310610:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.310616:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310625:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310646:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580310.310665:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.310672:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.310680:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e49f67 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312065:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49f91 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e200 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312201:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312219:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312234:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312253:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312274:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312281:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312390:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312398:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312404:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312410:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.312414:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.312421:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313554:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.313558:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.313565:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313573:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e49f98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313592:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313608:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313615:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313620:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.313623:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313631:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313639:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185aa300) 00010000:00010000:2.0:1777580310.313642:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.313646:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313651:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e49f9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313711:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49f91 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e200 expref: 461 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313723:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.313725:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.313729:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e49f91 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e200 expref: 461 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.313751:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:2.0:1777580310.313835:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282951:x1863919946598400:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3454us (4245us total) trans 0 rc 301/301 00000100:00100000:2.0:1777580310.313858:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19327 00000100:00100000:2.0:1777580310.313868:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831237538690 time 7831259229667 state 0x2 ref 0 00000100:00100000:2.0:1777580310.350202:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.350238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.350568:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598528 00000100:00100000:3.0:1777580310.350582:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598528 00000100:00100000:3.0:1777580310.350667:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11796 00000100:00100000:3.0:1777580310.350679:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+44:2362:x1863919946598528:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.351185:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+45:2362:x1863919946598528:12345-192.168.202.9@tcp:2:touch.500 Request processed in 508us (1000us total) trans 8589938959 rc 0/0 00000100:00100000:3.0:1777580310.351195:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11796 00000100:00100000:1.0:1777580310.352901:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946598784 00000100:00100000:1.0:1777580310.352917:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946598784 00000100:00100000:1.0:1777580310.352993:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4146 00000100:00100000:1.0:1777580310.353005:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282962:x1863919946598784:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580310.357029:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.357426:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599040 00000100:00100000:3.0:1777580310.357438:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599040 00000100:00100000:3.0:1777580310.357487:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831237538690 time 7831259229667 state 0x0 ref 1 00000100:00100000:3.0:1777580310.357502:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831259329667 time 7831259229667 state 0x1 ref 1 00000100:00100000:3.0:1777580310.357532:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831259329667 time 7831306393769 state 0x0 ref 1 00000100:00100000:3.0:1777580310.357545:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282966:x1863919946599040:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.357624:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.357663:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e49d68 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e158 expref: 462 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357690:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e49ba8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7da:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0ef expref: 461 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357703:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa024acb37500) 00010000:00010000:3.0:1777580310.357716:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.357747:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357765:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357778:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357827:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357837:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357845:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.357998:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358007:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358015:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.358623:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1851, 64 off126656 00010000:00010000:3.0:1777580310.358698:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358709:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358719:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358726:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358733:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358747:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358772:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.358800:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358807:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358814:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358820:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.358826:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358835:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358857:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580310.358861:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.358866:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358873:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e49fb4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358895:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358913:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358919:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358925:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.358928:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358934:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358943:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.358945:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.358949:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.358955:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e49fa6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.358967:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002652bf68 reply state 00000000f7b09089 transno 8589950600 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.358976:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580310.359162:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282962:x1863919946598784:12345-192.168.202.9@tcp:35:touch.500 Request processed in 6152us (8915us total) trans 8589950599 rc 0/0 00000100:00100000:1.0:1777580310.359176:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4146 00000100:00100000:3.0:1777580310.362966:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282966:x1863919946599040:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5403us (5929us total) trans 8589950600 rc 0/0 00000100:00100000:3.0:1777580310.362984:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19328 00000100:00100000:3.0:1777580310.362995:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831259329667 time 7831306393769 state 0x2 ref 0 00010000:00010000:3.0:1777580310.363091:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.363101:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.363114:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.363120:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.363147:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.363170:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7da:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580310.363173:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.363179:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.363186:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e49fbb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7da:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.363211:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.363213:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.363214:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.378184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.378362:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599296 00000100:00100000:1.0:1777580310.378377:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599296 00000100:00100000:1.0:1777580310.378451:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4147 00000100:00100000:1.0:1777580310.378462:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282960:x1863919946599296:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580310.378969:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282960:x1863919946599296:12345-192.168.202.9@tcp:35:touch.500 Request processed in 507us (798us total) trans 8589950601 rc 0/0 00000100:00100000:1.0:1777580310.378977:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4147 00000100:00100000:1.0:1777580310.403046:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.407839:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599552 00000100:00100000:3.0:1777580310.407871:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599552 00000100:00100000:3.0:1777580310.407938:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831259329667 time 7831306393769 state 0x0 ref 1 00000100:00100000:3.0:1777580310.407973:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831306493769 time 7831306393769 state 0x1 ref 1 00000100:00100000:3.0:1777580310.408008:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831306493769 time 7831356870323 state 0x0 ref 1 00000100:00100000:3.0:1777580310.408051:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282952:x1863919946599552:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.408180:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.408219:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e49db5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e15f expref: 462 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408249:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49a43 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0a9 expref: 461 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408261:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa024acb37100) 00010000:00010000:3.0:1777580310.408276:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.408309:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408328:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408339:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408356:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408362:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408368:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408525:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408540:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.408548:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.409131:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1854, 64 off126848 00010000:00010000:3.0:1777580310.409237:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409248:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409256:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409264:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409270:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409277:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409305:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.409331:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409337:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409355:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409362:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.409367:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409376:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409387:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa02497a21a00) 00010000:00010000:3.0:1777580310.409390:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.409394:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409400:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e49fd0 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409420:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409426:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409432:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409437:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.409440:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409455:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409464:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.409466:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.409469:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409475:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e49fc2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.409489:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d01af482 reply state 00000000f07e3360 transno 8589950602 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.409500:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.409618:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282952:x1863919946599552:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1572us (6582us total) trans 8589950602 rc 0/0 00000100:00100000:3.0:1777580310.409627:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19329 00000100:00100000:3.0:1777580310.409634:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831306493769 time 7831356870323 state 0x2 ref 0 00010000:00010000:3.0:1777580310.409684:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409691:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409697:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409702:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.409712:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409718:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409727:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024185ac900) 00010000:00010000:3.0:1777580310.409730:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.409732:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.409738:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e49fad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410010:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580310.410019:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410026:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580310.410029:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410048:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410057:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d7:0x0].0x0 (ffffa02497a21a00) 00010000:00010000:1.0:1777580310.410060:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580310.410063:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410069:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e49fd7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.410083:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580310.410084:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580310.410086:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580310.438301:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.438328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.438358:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599680 00000100:00100000:2.0:1777580310.438369:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599680 00000100:00100000:2.0:1777580310.438417:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831306493769 time 7831356870323 state 0x0 ref 1 00000100:00100000:2.0:1777580310.438433:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831356970323 time 7831356870323 state 0x1 ref 1 00000100:00100000:2.0:1777580310.438452:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599808 00000100:00100000:2.0:1777580310.438455:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599808 00000100:00100000:2.0:1777580310.438464:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831356970323 time 7831356870323 state 0x1 ref 2 00000100:00100000:2.0:1777580310.438480:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831387443133 time 7831387343133 state 0x1 ref 2 00000100:00100000:2.0:1777580310.438491:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282969:x1863919946599680:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.438521:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.438546:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49fde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e207 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438651:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438669:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438682:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438696:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438703:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438710:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438834:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438841:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438861:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.438893:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7dd:0x0]: returning size 0 00000004:00200000:2.0:1777580310.438897:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.438917:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438941:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438950:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438958:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438966:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438972:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.438976:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438984:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.438996:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.438999:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.439003:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439009:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e49fe5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439022:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439029:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439039:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439044:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.439047:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439052:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439059:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024185aa300) 00010000:00010000:2.0:1777580310.439061:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.439063:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439068:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e49fec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439098:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e49fde lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e207 expref: 464 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439110:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e207 expref: 463 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439117:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:2.0:1777580310.439119:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.439121:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:2.0:1777580310.439224:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282969:x1863919946599680:12345-192.168.202.9@tcp:101:rm.500 Request processed in 733us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.439243:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19330 00000100:00100000:2.0:1777580310.439272:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831387443133 time 7831388134215 state 0x0 ref 1 00000100:00100000:2.0:1777580310.439284:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282972:x1863919946599808:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.439293:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.439303:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49ffa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e20e expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439332:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439341:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439348:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439359:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439366:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439372:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439423:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439430:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439443:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.439461:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e0:0x0]: returning size 0 00000004:00200000:2.0:1777580310.439464:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.439473:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439480:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439487:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439494:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439500:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439505:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.439507:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439513:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439519:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.439521:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.439524:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439537:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a001 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439548:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439553:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439559:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439564:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.439567:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439572:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439578:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024185aa000) 00010000:00010000:2.0:1777580310.439580:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.439582:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439588:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a008 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439606:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e49ffa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e20e expref: 464 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439625:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e20e expref: 463 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.439632:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02499479b00) 00010000:00010000:2.0:1777580310.439635:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.439637:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:2.0:1777580310.439657:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282972:x1863919946599808:12345-192.168.202.9@tcp:101:rm.500 Request processed in 376us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.439663:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19331 00000100:00100000:2.0:1777580310.439667:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831387443133 time 7831388134215 state 0x2 ref 0 00000100:00100000:2.0:1777580310.439736:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.439884:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580310.440014:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440023:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440029:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440034:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.440037:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440044:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440053:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02498a66600) 00010000:00010000:1.0:1777580310.440062:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.440065:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440071:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e49fc9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.440104:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946599936 00000100:00100000:1.0:1777580310.440111:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946599936 00000100:00100000:1.0:1777580310.440169:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831387443133 time 7831388134215 state 0x0 ref 1 00000100:00100000:1.0:1777580310.440180:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831388234215 time 7831388134215 state 0x1 ref 1 00000100:00100000:1.0:1777580310.440199:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600064 00000100:00100000:1.0:1777580310.440202:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600064 00000100:00100000:1.0:1777580310.440212:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831388234215 time 7831388134215 state 0x1 ref 2 00000100:00100000:1.0:1777580310.440227:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389190466 time 7831389090466 state 0x1 ref 2 00000100:00100000:1.0:1777580310.440237:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282975:x1863919946599936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.440249:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.440263:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a016 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e215 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440306:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440315:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440325:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440344:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440351:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440358:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440435:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440442:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440449:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580310.440472:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e3:0x0]: returning size 0 00000004:00200000:1.0:1777580310.440474:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580310.440486:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440495:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440502:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440508:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440522:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440528:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.440530:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440536:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440543:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.440546:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.440549:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440556:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a01d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440566:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440571:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440577:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440582:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.440585:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440598:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440605:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580310.440607:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.440609:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440614:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a024 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440638:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a016 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e215 expref: 465 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440649:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e215 expref: 464 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440655:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580310.440657:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580310.440659:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838e00, rc 0) 00000100:00100000:1.0:1777580310.440706:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282975:x1863919946599936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 470us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.440713:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19332 00000100:00100000:1.0:1777580310.440732:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389190466 time 7831389595367 state 0x0 ref 1 00000100:00100000:1.0:1777580310.440740:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282971:x1863919946600064:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.440747:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.440760:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e21c expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440786:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440794:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440800:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440809:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440815:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440821:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440862:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440868:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440874:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440879:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.440882:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440897:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440905:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.440907:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.440909:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440915:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a039 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440924:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440930:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440936:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440941:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580310.440943:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440948:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440954:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02483f8e600) 00010000:00010000:1.0:1777580310.440956:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.440958:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440970:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a040 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.440990:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a032 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e21c expref: 464 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.441000:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580310.441002:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580310.441005:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a032 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e21c expref: 464 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.441013:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839800, rc 0) 00000100:00100000:1.0:1777580310.441032:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282971:x1863919946600064:12345-192.168.202.9@tcp:101:rm.500 Request processed in 292us (1149us total) trans 0 rc 301/301 00000100:00100000:1.0:1777580310.441038:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19333 00000100:00100000:1.0:1777580310.441042:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389190466 time 7831389595367 state 0x2 ref 0 00000100:00100000:2.0:1777580310.460180:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.460228:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.460267:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600192 00000100:00100000:2.0:1777580310.460279:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600192 00000100:00100000:2.0:1777580310.460329:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389190466 time 7831389595367 state 0x0 ref 1 00000100:00100000:2.0:1777580310.460347:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389695367 time 7831389595367 state 0x1 ref 1 00000100:00100000:2.0:1777580310.460370:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600320 00000100:00100000:2.0:1777580310.460374:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600320 00000100:00100000:2.0:1777580310.460386:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831389695367 time 7831389595367 state 0x1 ref 2 00000100:00100000:2.0:1777580310.460419:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831409380587 time 7831409280587 state 0x1 ref 2 00000100:00100000:2.0:1777580310.460432:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282973:x1863919946600192:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.460477:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.460506:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a047 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e223 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460595:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460614:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460628:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460645:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460652:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460659:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460807:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460824:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460832:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.460880:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e1:0x0]: returning size 0 00000004:00200000:2.0:1777580310.460892:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.460920:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460937:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460946:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460955:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460964:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460972:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.460977:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.460985:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461000:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.461004:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.461009:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461016:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a04e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461032:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461050:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461058:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461064:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.461067:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461074:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461083:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024185aa300) 00010000:00010000:2.0:1777580310.461086:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.461089:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461095:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a055 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461164:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a047 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e223 expref: 466 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461182:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e223 expref: 465 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461191:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02497a21b00) 00010000:00010000:2.0:1777580310.461194:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.461206:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:2.0:1777580310.461287:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:282973:x1863919946600192:12345-192.168.202.9@tcp:101:rm.500 Request processed in 856us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.461296:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19334 00000100:00100000:2.0:1777580310.461330:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831409380587 time 7831410192146 state 0x0 ref 1 00000100:00100000:2.0:1777580310.461344:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282970:x1863919946600320:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.461356:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.461367:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a063 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e22a expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461404:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461413:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461422:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461437:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461444:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461451:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461518:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461533:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461539:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.461562:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7df:0x0]: returning size 0 00000004:00200000:2.0:1777580310.461566:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.461576:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461584:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461591:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461598:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461604:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461609:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.461613:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461619:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461626:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.461635:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.461639:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461644:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a06a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461656:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461662:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461667:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461672:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.461675:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461680:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461687:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa0249881d200) 00010000:00010000:2.0:1777580310.461689:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.461692:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461697:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a071 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461719:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a063 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e22a expref: 466 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461740:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e22a expref: 465 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.461747:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa024997a0b00) 00010000:00010000:2.0:1777580310.461750:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.461752:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:2.0:1777580310.461779:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:282970:x1863919946600320:12345-192.168.202.9@tcp:101:rm.500 Request processed in 439us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.461786:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19335 00000100:00100000:2.0:1777580310.461790:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831409380587 time 7831410192146 state 0x2 ref 0 00000100:00100000:2.0:1777580310.461893:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.461985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.462008:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600448 00000100:00100000:2.0:1777580310.462017:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600448 00000100:00100000:2.0:1777580310.462040:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831409380587 time 7831410192146 state 0x0 ref 1 00000100:00100000:2.0:1777580310.462050:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831410292146 time 7831410192146 state 0x1 ref 1 00000100:00100000:2.0:1777580310.462071:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600576 00000100:00100000:2.0:1777580310.462074:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600576 00000100:00100000:2.0:1777580310.462085:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831410292146 time 7831410192146 state 0x1 ref 2 00000100:00100000:2.0:1777580310.462103:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411066356 time 7831410966356 state 0x1 ref 2 00000100:00100000:2.0:1777580310.462113:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:282974:x1863919946600448:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.462124:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.462172:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a07f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e231 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462213:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462221:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462229:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462242:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462250:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462257:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462339:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462349:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462357:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580310.462383:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e2:0x0]: returning size 0 00000004:00200000:2.0:1777580310.462387:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.462401:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462418:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462426:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462434:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462440:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462446:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.462448:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462454:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462463:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.462465:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.462468:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462473:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a086 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462484:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462490:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462502:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462508:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.462511:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462517:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462524:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0249881dd00) 00010000:00010000:2.0:1777580310.462526:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.462529:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462534:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a08d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462562:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a07f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e231 expref: 468 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462573:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e231 expref: 467 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462579:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02417834e00) 00010000:00010000:2.0:1777580310.462582:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.462584:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1400, rc 0) 00000100:00100000:2.0:1777580310.462616:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:282974:x1863919946600448:12345-192.168.202.9@tcp:101:rm.500 Request processed in 504us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.462635:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19336 00000100:00100000:2.0:1777580310.462656:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411066356 time 7831411519294 state 0x0 ref 1 00000100:00100000:2.0:1777580310.462666:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:282976:x1863919946600576:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580310.462675:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.462683:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a09b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e238 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462712:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462719:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462726:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462740:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462747:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462753:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462806:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462814:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.462828:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.466489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.466548:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.466598:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580310.466637:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600704 00000100:00100000:1.0:1777580310.466650:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600704 00000100:00100000:1.0:1777580310.466710:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600832 00000100:00100000:1.0:1777580310.466713:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600832 00000100:00100000:1.0:1777580310.466732:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946600960 00000100:00100000:1.0:1777580310.466735:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946600960 00000100:00100000:1.0:1777580310.466769:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11797 00000100:00100000:1.0:1777580310.466782:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+46:2361:x1863919946600704:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.466838:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.466881:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e23f expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580310.466925:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c2:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:1.0:1777580310.466961:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.466964:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.466977:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 47 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467000:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 47 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467019:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839400, rc 0) 00000100:00100000:1.0:1777580310.467088:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2361:x1863919946600704:12345-192.168.202.9@tcp:101:rm.500 Request processed in 309us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.467096:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11797 00000100:00100000:1.0:1777580310.467118:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11798 00000100:00100000:1.0:1777580310.467124:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+46:2361:x1863919946600832:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.467132:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.467177:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e246 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580310.467192:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c3:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:1.0:1777580310.467202:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.467211:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.467217:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 47 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467230:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 47 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467239:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839c00, rc 0) 00000100:00100000:1.0:1777580310.467276:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2361:x1863919946600832:12345-192.168.202.9@tcp:101:rm.500 Request processed in 152us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.467283:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11798 00000100:00100000:1.0:1777580310.467297:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11799 00000100:00100000:1.0:1777580310.467304:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2361:x1863919946600960:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580310.467313:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.467328:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e24d expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580310.467347:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a0:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:1.0:1777580310.467358:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.467360:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580310.467364:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 40 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467376:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 40 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.467399:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838a00, rc 0) 00000100:00100000:1.0:1777580310.467419:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2361:x1863919946600960:12345-192.168.202.9@tcp:101:rm.500 Request processed in 116us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.467426:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11799 00000004:00200000:2.0:1777580310.471059:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e4:0x0]: returning size 0 00000004:00200000:2.0:1777580310.471072:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580310.471121:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471180:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471194:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471204:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471213:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471221:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.471226:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471235:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471357:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.471361:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.471367:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471398:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471415:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.471421:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473005:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473014:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.473019:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473029:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473049:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02427669b00) 00010000:00010000:2.0:1777580310.473053:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.473058:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473066:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473163:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a09b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e238 expref: 468 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473205:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e238 expref: 467 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.473214:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa024185ac100) 00010000:00010000:2.0:1777580310.473217:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.473220:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69be400, rc 0) 00000100:00100000:2.0:1777580310.473310:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:282976:x1863919946600576:12345-192.168.202.9@tcp:101:rm.500 Request processed in 10643us (11323us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580310.473323:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19337 00000100:00100000:2.0:1777580310.473332:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411066356 time 7831411519294 state 0x2 ref 0 00000100:00100000:3.0:1777580310.489903:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.489949:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.489973:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.490000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.490080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.490115:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601088 00000100:00100000:3.0:1777580310.490128:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601088 00000100:00100000:3.0:1777580310.491003:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601216 00000100:00100000:3.0:1777580310.491012:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601216 00000100:00100000:3.0:1777580310.491055:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601344 00000100:00100000:3.0:1777580310.491059:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601344 00000100:00100000:3.0:1777580310.491083:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601728 00000100:00100000:3.0:1777580310.491086:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601728 00000100:00100000:3.0:1777580310.491112:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11800 00000100:00100000:3.0:1777580310.491124:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2363:x1863919946601088:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.491172:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.491201:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e254 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.491253:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159e:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.491278:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491281:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491292:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491315:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491332:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50a00, rc 0) 00000100:00100000:3.0:1777580310.491408:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2363:x1863919946601088:12345-192.168.202.9@tcp:101:rm.500 Request processed in 286us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.491416:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11800 00000100:00100000:3.0:1777580310.491533:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11801 00000100:00100000:3.0:1777580310.491541:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+48:2361:x1863919946601216:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.491551:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.491566:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e25b expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.491584:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c5:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.491595:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491597:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491602:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 49 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491634:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 49 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491644:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51000, rc 0) 00000100:00100000:3.0:1777580310.491668:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+49:2361:x1863919946601216:12345-192.168.202.9@tcp:101:rm.500 Request processed in 128us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.491674:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11801 00000100:00100000:3.0:1777580310.491688:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11802 00000100:00100000:3.0:1777580310.491695:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+48:2363:x1863919946601344:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.491702:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.491713:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e262 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.491727:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c4:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.491737:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491739:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491744:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 49 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491755:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 49 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491764:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50600, rc 0) 00000100:00100000:3.0:1777580310.491786:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+49:2363:x1863919946601344:12345-192.168.202.9@tcp:101:rm.500 Request processed in 92us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.491798:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11802 00000100:00100000:3.0:1777580310.491813:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11803 00000100:00100000:3.0:1777580310.491932:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2362:x1863919946601728:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580310.491941:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.491953:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e269 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580310.491969:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x159f:0x0] initial LVB size: 0, mtime: 0x69f3b915, atime: 0x69f3b915, ctime: 0x69f3b915, blocks: 0x1 00010000:00010000:3.0:1777580310.491979:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491981:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580310.491986:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.491998:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.492008:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50e00, rc 0) 00000100:00100000:3.0:1777580310.492030:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2362:x1863919946601728:12345-192.168.202.9@tcp:101:rm.500 Request processed in 101us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.492037:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11803 00000100:00100000:2.0:1777580310.492231:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601600 00000100:00100000:2.0:1777580310.492240:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601600 00000100:00100000:2.0:1777580310.492276:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411066356 time 7831411519294 state 0x0 ref 1 00000100:00100000:2.0:1777580310.492289:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411619294 time 7831411519294 state 0x1 ref 1 00000100:00100000:2.0:1777580310.492315:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411619294 time 7831441175863 state 0x0 ref 1 00000100:00100000:2.0:1777580310.492326:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:282964:x1863919946601600:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580310.492383:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580310.492411:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e49dd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e16d expref: 467 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492528:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e49b5b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0e1 expref: 466 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492557:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa024acb37800) 00010000:00010000:2.0:1777580310.492569:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580310.492594:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492609:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492619:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492632:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492639:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492645:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492797:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492806:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.492925:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580310.496018:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1855, 64 off126912 00000004:00080000:2.0:1777580310.496039:0:187630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7831444903267ns, next at 7832444897447ns, rc = 0 00010000:00010000:2.0:1777580310.496206:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496229:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496245:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496256:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496263:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496271:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.496306:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580310.499610:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580310.499627:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.499640:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580310.499645:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.499656:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.499687:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa02427669000) 00010000:00010000:0.0:1777580310.499691:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580310.499696:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.499702:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a0fd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.499722:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580310.499724:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580310.499726:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580310.500178:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500190:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500198:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500204:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.500208:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500215:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500234:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7d9:0x0].0x0 (ffffa02427669000) 00010000:00010000:2.0:1777580310.500236:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580310.500240:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500247:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a0f6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500281:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500288:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500293:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500299:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.500301:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500308:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500315:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.500318:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.500321:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.500327:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a0e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.500352:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f048d40a reply state 000000001ef2032b transno 8589950603 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.500363:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.502082:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:282964:x1863919946601600:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9741us (12064us total) trans 8589950603 rc 0/0 00000100:00100000:2.0:1777580310.502098:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19338 00000100:00100000:2.0:1777580310.502108:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411619294 time 7831441175863 state 0x2 ref 0 00010000:00010000:3.0:1777580310.514463:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514485:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514517:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514523:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.514528:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514537:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514558:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02427669b00) 00010000:00010000:3.0:1777580310.514562:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.514567:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.514574:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a0ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.515323:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.515685:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946601984 00000100:00100000:3.0:1777580310.515698:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946601984 00000100:00100000:3.0:1777580310.515747:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831411619294 time 7831441175863 state 0x0 ref 1 00000100:00100000:3.0:1777580310.515763:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831441275863 time 7831441175863 state 0x1 ref 1 00000100:00100000:3.0:1777580310.515791:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831441275863 time 7831464653613 state 0x0 ref 1 00000100:00100000:3.0:1777580310.515805:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:282967:x1863919946601984:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.515908:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.515939:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e49d92 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e166 expref: 466 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.515982:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e49c03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0fd expref: 465 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.515993:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580310.516002:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.516033:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516051:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516061:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516079:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516086:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516092:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516281:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516290:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.516298:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.516927:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1856, 64 off126976 00010000:00010000:3.0:1777580310.517007:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517019:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517029:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517036:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517043:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517049:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517076:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.517100:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517105:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517112:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517118:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.517122:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517168:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517180:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.517183:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.517187:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517194:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a112 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517212:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517218:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517224:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517228:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.517231:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517236:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517243:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.517246:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.517249:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517265:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a104 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.517277:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fd5d5bc8 reply state 0000000031c60e88 transno 8589950604 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.517287:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.517409:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:282967:x1863919946601984:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1603us (2090us total) trans 8589950604 rc 0/0 00000100:00100000:3.0:1777580310.517420:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19339 00000100:00100000:3.0:1777580310.517428:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831441275863 time 7831464653613 state 0x2 ref 0 00010000:00010000:3.0:1777580310.517591:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.517599:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517605:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.517608:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517615:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517624:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7db:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.517626:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.517629:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517635:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a119 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7db:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.517663:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.517665:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.517667:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580310.534476:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.534775:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534793:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534802:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534809:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.534820:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534830:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534858:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.534862:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.534868:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.534874:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a10b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.540524:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946602240 00000100:00100000:2.0:1777580310.540542:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946602240 00000100:00100000:2.0:1777580310.540602:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831441275863 time 7831464653613 state 0x0 ref 1 00000100:00100000:2.0:1777580310.540619:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831464753613 time 7831464653613 state 0x1 ref 1 00000100:00100000:2.0:1777580310.540656:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831464753613 time 7831489518458 state 0x0 ref 1 00000100:00100000:2.0:1777580310.540673:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:282968:x1863919946602240:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580310.540762:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580310.540798:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e49ded lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e174 expref: 465 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540840:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e49c42 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e10b expref: 464 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540881:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa024acb37900) 00010000:00010000:2.0:1777580310.540895:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580310.540929:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540946:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540958:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540976:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540984:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.540991:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.541185:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.541194:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.541201:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580310.541859:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1852, 64 off126720 00010000:00010000:2.0:1777580310.541961:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.541982:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.541993:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542002:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542010:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542017:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542041:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580310.542069:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542076:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542083:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542090:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.542096:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542104:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542128:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580310.542131:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580310.542166:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542174:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a12e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542197:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542204:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542210:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542216:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.542220:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542226:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542234:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.542237:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.542240:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.542245:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a120 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.542267:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000013ae1576 reply state 0000000086aef3b1 transno 8589950605 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.542276:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.542400:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:282968:x1863919946602240:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1730us (7936us total) trans 8589950605 rc 0/0 00000100:00100000:2.0:1777580310.542411:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19340 00000100:00100000:2.0:1777580310.542420:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831464753613 time 7831489518458 state 0x2 ref 0 00010000:00010000:3.0:1777580310.542699:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.542708:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.542728:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.542732:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.542740:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.542751:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dc:0x0].0x0 (ffffa02427669200) 00010000:00010000:3.0:1777580310.542754:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.542757:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.542764:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a135 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7dc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.542781:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.542784:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.542786:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.546265:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580310.547472:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547494:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547503:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547509:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.547515:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547524:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547547:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02427669000) 00010000:00010000:2.0:1777580310.547550:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.547555:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.547584:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a127 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580310.547697:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946602368 00000100:00100000:0.0:1777580310.547710:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946602368 00000100:00100000:0.0:1777580310.547758:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831464753613 time 7831489518458 state 0x0 ref 1 00000100:00100000:0.0:1777580310.547772:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831489618458 time 7831489518458 state 0x1 ref 1 00000100:00100000:0.0:1777580310.547805:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831489618458 time 7831496667327 state 0x0 ref 1 00000100:00100000:0.0:1777580310.547835:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282971:x1863919946602368:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580310.547875:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580310.547896:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a13c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e270 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.547983:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.547999:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548022:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548040:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548047:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548053:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548178:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548186:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548192:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548197:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.548200:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548206:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548214:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580310.548216:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.548219:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548231:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a143 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548252:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548259:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548265:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548271:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.548274:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548280:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548289:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02499549300) 00010000:00010000:0.0:1777580310.548292:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.548295:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548301:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a14a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548338:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a13c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e270 expref: 465 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548366:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580310.548368:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.548372:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a13c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e270 expref: 465 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.548382:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6ec00, rc 0) 00000100:00100000:0.0:1777580310.548466:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282971:x1863919946602368:12345-192.168.202.9@tcp:101:rm.500 Request processed in 639us (2226us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580310.548475:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19341 00000100:00100000:0.0:1777580310.548481:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831489618458 time 7831496667327 state 0x2 ref 0 00000100:00100000:2.0:1777580310.569002:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.569093:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946602624 00000100:00100000:3.0:1777580310.569108:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946602624 00000100:00100000:3.0:1777580310.569188:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831489618458 time 7831496667327 state 0x0 ref 1 00000100:00100000:3.0:1777580310.569204:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831496767327 time 7831496667327 state 0x1 ref 1 00000100:00100000:3.0:1777580310.569231:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831496767327 time 7831518093112 state 0x0 ref 1 00000100:00100000:3.0:1777580310.569244:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282975:x1863919946602624:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.569323:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.569374:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a02b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e215 expref: 464 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569402:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e49f7c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f2 expref: 463 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569416:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:3.0:1777580310.569441:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.569472:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569490:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569502:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569519:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569526:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569532:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569681:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569690:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.569708:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.570364:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1853, 64 off126784 00010000:00010000:3.0:1777580310.570445:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570457:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570467:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570475:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570481:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570488:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570509:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.570535:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570541:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570547:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570564:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.570569:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570578:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570594:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.570597:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.570602:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570608:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a15f lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570631:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570638:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570644:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570649:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.570651:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570657:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570675:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.570678:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.570681:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.570686:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a151 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.570696:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000df742307 reply state 00000000c3c31217 transno 8589950606 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.570704:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.570805:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:282975:x1863919946602624:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1560us (1819us total) trans 8589950606 rc 0/0 00000100:00100000:3.0:1777580310.570815:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19342 00000100:00100000:3.0:1777580310.570822:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831496767327 time 7831518093112 state 0x2 ref 0 00010000:00010000:3.0:1777580310.571003:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.571010:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.571017:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.571021:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.571027:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.571035:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e3:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.571038:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.571047:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.571053:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a166 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.571068:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.571070:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.571072:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.577747:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577773:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577783:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577791:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.577797:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577806:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577840:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.577853:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.577859:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.577867:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a158 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.578392:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.579396:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946602880 00000100:00100000:3.0:1777580310.579410:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946602880 00000100:00100000:3.0:1777580310.582059:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831496767327 time 7831518093112 state 0x0 ref 1 00000100:00100000:3.0:1777580310.582081:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831518193112 time 7831518093112 state 0x1 ref 1 00000100:00100000:3.0:1777580310.582130:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831518193112 time 7831530992743 state 0x0 ref 1 00000100:00100000:3.0:1777580310.582167:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282972:x1863919946602880:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.582251:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.582298:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a00f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e20e expref: 463 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.582327:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e49eb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1c1 expref: 462 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.582340:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580310.582353:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.582385:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.582403:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.582415:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583400:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583513:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583524:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583688:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583697:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.583705:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.584350:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1857, 64 off127040 00010000:00010000:3.0:1777580310.588297:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588329:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588345:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588357:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588365:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588373:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588421:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.588459:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.588466:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588474:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.588478:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588487:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588502:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.588505:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.588512:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588518:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a182 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588535:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.588537:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.588539:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.588559:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588566:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588573:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588589:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.588595:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588601:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588611:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e0:0x0].0x0 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.588613:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.588616:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588622:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a17b lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588653:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588661:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588667:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588672:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.588675:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588682:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588701:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.588704:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.588708:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.588714:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a16d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.588732:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c6fb889c reply state 00000000218e7a6c transno 8589950607 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.588742:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.588905:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:282972:x1863919946602880:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6742us (10514us total) trans 8589950607 rc 0/0 00000100:00100000:3.0:1777580310.588918:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19343 00000100:00100000:3.0:1777580310.588929:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831518193112 time 7831530992743 state 0x2 ref 0 00010000:00010000:3.0:1777580310.603639:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603661:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603670:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603677:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.603683:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603709:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603733:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.603736:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.603742:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.603750:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4a174 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.605008:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.607076:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946603136 00000100:00100000:3.0:1777580310.607099:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946603136 00000100:00100000:3.0:1777580310.607186:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831518193112 time 7831530992743 state 0x0 ref 1 00000100:00100000:3.0:1777580310.607203:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831531092743 time 7831530992743 state 0x1 ref 1 00000100:00100000:3.0:1777580310.607234:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831531092743 time 7831556096258 state 0x0 ref 1 00000100:00100000:3.0:1777580310.607254:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282969:x1863919946603136:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.607334:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.607369:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e49ff3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e207 expref: 462 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.607398:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e49cce lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e127 expref: 461 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.607411:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa024acb37a00) 00010000:00010000:3.0:1777580310.608989:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.609029:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609049:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609062:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609079:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609086:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609093:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609265:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609275:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.609282:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.613360:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1858, 64 off127104 00010000:00010000:3.0:1777580310.614724:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.614756:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.614786:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.614797:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.614805:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.615968:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616004:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.616046:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616054:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616061:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616068:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.616073:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616083:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616100:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.616104:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.616120:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616128:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a197 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616172:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616179:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616186:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616193:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.616196:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616203:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616212:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.616214:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.616217:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.616223:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a189 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.616235:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007eaaae4b reply state 0000000005831d7a transno 8589950608 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.616256:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.616397:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:282969:x1863919946603136:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9145us (11394us total) trans 8589950608 rc 0/0 00000100:00100000:3.0:1777580310.616409:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19344 00000100:00100000:3.0:1777580310.616419:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831531092743 time 7831556096258 state 0x2 ref 0 00010000:00010000:3.0:1777580310.620747:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.620758:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.620770:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.620776:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.620787:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.620809:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7dd:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.620813:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.620818:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.620825:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a19e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7dd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623582:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.623592:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.623595:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.623831:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.623885:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623913:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623923:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623931:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.623939:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623948:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623970:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.623974:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.623980:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.623988:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a190 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580310.624713:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946603392 00000100:00100000:0.0:1777580310.624730:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946603392 00000100:00100000:0.0:1777580310.624780:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831531092743 time 7831556096258 state 0x0 ref 1 00000100:00100000:0.0:1777580310.624796:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831556196258 time 7831556096258 state 0x1 ref 1 00000100:00100000:0.0:1777580310.624855:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831556196258 time 7831573708328 state 0x0 ref 1 00000100:00100000:0.0:1777580310.624873:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282973:x1863919946603392:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580310.624957:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580310.624984:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a05c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e223 expref: 461 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625008:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e49efe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1d6 expref: 460 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625038:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02497a21b00) 00010000:00010000:0.0:1777580310.625049:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580310.625080:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625098:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625109:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625126:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625162:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.625170:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.634812:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.634836:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.634862:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580310.635424:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1854, 64 off126848 00010000:00010000:0.0:1777580310.635604:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635623:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635633:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635641:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635649:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635655:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635676:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580310.635702:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635707:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635713:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635719:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.635725:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635733:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635753:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02499549a00) 00010000:00010000:0.0:1777580310.635756:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580310.635761:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635768:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a1b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635790:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635796:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635801:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635807:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.635809:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635815:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635821:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580310.635823:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.635826:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.635831:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a1a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580310.635860:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009c3f77f6 reply state 000000003aea0b4b transno 8589950609 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580310.635869:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580310.635981:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:282973:x1863919946603392:12345-192.168.202.9@tcp:36:rm.500 Request processed in 11109us (12160us total) trans 8589950609 rc 0/0 00000100:00100000:0.0:1777580310.635993:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19345 00000100:00100000:0.0:1777580310.636002:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831556196258 time 7831573708328 state 0x2 ref 0 00010000:00010000:3.0:1777580310.637956:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.637975:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.637990:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.637996:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.638007:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.638042:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e1:0x0].0x0 (ffffa02499549a00) 00010000:00010000:3.0:1777580310.638046:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.638052:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.638059:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a1ba lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.638091:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.638093:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.638094:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580310.657524:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.657558:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657571:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657579:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657585:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.657591:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657599:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657619:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02499549300) 00010000:00010000:3.0:1777580310.657622:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.657640:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657647:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a1ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.657701:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946603648 00000100:00100000:3.0:1777580310.657713:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946603648 00000100:00100000:3.0:1777580310.657756:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831556196258 time 7831573708328 state 0x0 ref 1 00000100:00100000:3.0:1777580310.657769:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831573808328 time 7831573708328 state 0x1 ref 1 00000100:00100000:3.0:1777580310.657797:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831573808328 time 7831606659375 state 0x0 ref 1 00000100:00100000:3.0:1777580310.657811:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282970:x1863919946603648:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.657908:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.657931:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a078 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e22a expref: 460 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657948:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e49e56 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1ac expref: 459 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.657958:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa024997a0b00) 00010000:00010000:3.0:1777580310.657966:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.657996:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658012:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658025:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658050:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658058:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658066:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658247:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658256:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.658263:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.663735:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1855, 64 off126912 00010000:00010000:3.0:1777580310.663841:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663878:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663894:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663905:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663912:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663931:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.663960:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.663996:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.664003:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664010:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.664014:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664022:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664035:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.664039:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.664044:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664050:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a1d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664067:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.664069:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.664071:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.664088:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664095:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664111:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664115:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.664120:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664125:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664158:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7df:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580310.664161:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.664163:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664169:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a1cf lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664194:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664200:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664207:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664212:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.664215:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664230:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664240:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.664243:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.664246:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.664251:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a1c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.664263:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a5a5dc6f reply state 000000000b0b53ba transno 8589950610 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.664273:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.664394:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282970:x1863919946603648:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6580us (6878us total) trans 8589950610 rc 0/0 00000100:00100000:3.0:1777580310.664406:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19346 00000100:00100000:3.0:1777580310.664415:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831573808328 time 7831606659375 state 0x2 ref 0 00000100:00100000:3.0:1777580310.683038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.683078:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946603904 00000100:00100000:3.0:1777580310.683090:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946603904 00000100:00100000:3.0:1777580310.683161:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831573808328 time 7831606659375 state 0x0 ref 1 00000100:00100000:3.0:1777580310.683177:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831606759375 time 7831606659375 state 0x1 ref 1 00000100:00100000:3.0:1777580310.683205:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831606759375 time 7831632067245 state 0x0 ref 1 00000100:00100000:3.0:1777580310.683219:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282974:x1863919946603904:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.683926:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.683968:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a094 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e231 expref: 460 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.683994:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e49f2f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1e4 expref: 459 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684006:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580310.684018:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.684049:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684066:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684078:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684096:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684103:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684110:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684598:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684613:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.684635:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.686560:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1859, 64 off127168 00010000:00010000:3.0:1777580310.686693:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686715:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686727:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686737:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686744:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686751:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.686774:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.686805:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687627:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687638:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687663:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.687670:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687680:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687696:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.687700:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.687705:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687712:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a1eb lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687741:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687749:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687755:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687761:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.687764:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687770:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687790:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.687793:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.687796:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.687803:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a1dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.687831:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005019ad1c reply state 000000003f369a56 transno 8589950611 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.687850:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.687992:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:282974:x1863919946603904:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4769us (4962us total) trans 8589950611 rc 0/0 00000100:00100000:3.0:1777580310.688005:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19347 00000100:00100000:3.0:1777580310.688016:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831606759375 time 7831632067245 state 0x2 ref 0 00010000:00010000:3.0:1777580310.688070:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.688076:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688083:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.688087:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688095:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688104:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e2:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.688107:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.688120:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688127:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688164:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.688166:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.688168:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.688182:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688190:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688197:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688204:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.688208:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688214:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688222:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.688224:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.688227:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.688233:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a1c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.713162:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.718129:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718164:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718173:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718180:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.718185:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718194:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718216:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.718219:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.718223:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718230:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a1e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.718288:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946604160 00000100:00100000:3.0:1777580310.718301:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946604160 00000100:00100000:3.0:1777580310.718349:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831606759375 time 7831632067245 state 0x0 ref 1 00000100:00100000:3.0:1777580310.718362:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831632167245 time 7831632067245 state 0x1 ref 1 00000100:00100000:3.0:1777580310.718394:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831632167245 time 7831667256024 state 0x0 ref 1 00000100:00100000:3.0:1777580310.718765:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:282976:x1863919946604160:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580310.718858:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580310.718883:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a0b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e238 expref: 458 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718904:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e49f8a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1f9 expref: 457 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718918:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa024185ac100) 00010000:00010000:3.0:1777580310.718927:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.718958:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718974:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.718986:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719001:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719007:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719013:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719198:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719217:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.719224:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580310.725033:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1860, 64 off127232 00010000:00010000:3.0:1777580310.725174:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725199:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725215:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725226:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725234:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725240:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725268:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580310.725299:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725306:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725327:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725335:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.725340:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725349:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725364:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.725368:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580310.725374:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725380:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a207 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725406:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725412:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725417:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725493:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.725497:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725513:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725523:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.725525:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.725529:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725534:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a1f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.725546:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005004106d reply state 0000000008d93d88 transno 8589950612 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.725555:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.725672:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:282976:x1863919946604160:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7248us (12530us total) trans 8589950612 rc 0/0 00000100:00100000:3.0:1777580310.725684:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19348 00000100:00100000:3.0:1777580310.725694:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831632167245 time 7831667256024 state 0x2 ref 0 00010000:00010000:3.0:1777580310.725749:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580310.725756:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725762:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580310.725766:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725773:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725791:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e4:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.725794:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580310.725797:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.725802:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a20e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.728282:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.737192:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737208:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737215:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737221:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.737226:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737234:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737253:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.737256:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.737261:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737267:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a200 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.737331:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580310.737334:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580310.837682:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.839617:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946604416 00000100:00100000:3.0:1777580310.839637:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946604416 00000100:00100000:3.0:1777580310.839687:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831242964586 time 7831250965699 state 0x0 ref 1 00000100:00100000:3.0:1777580310.839701:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831251065699 time 7831250965699 state 0x1 ref 1 00000100:00100000:3.0:1777580310.839732:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831251065699 time 7831788594140 state 0x0 ref 1 00000100:00100000:3.0:1777580310.839750:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:282983:x1863919946604416:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.839788:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.839815:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a215 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e277 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840033:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840052:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840066:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840084:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840091:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.840110:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580310.843979:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a1:0x0], index 1: 0 00010000:00010000:3.0:1777580310.844283:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a22a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844307:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a22a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844321:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a22a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844367:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844375:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844382:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844389:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.844394:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844402:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844415:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.844431:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.844447:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.844453:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a21c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.844473:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fb6e4ea3 reply state 0000000012dd3dae transno 8589950613 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.844484:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580310.844536:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a215 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e277 expref: 151 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.846080:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a22a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e277 expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.846093:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa024185ac100) 00010000:00010000:3.0:1777580310.846096:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.846099:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030a00, rc 0) 00000100:00100000:3.0:1777580310.846231:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282983:x1863919946604416:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6486us (8559us total) trans 8589950613 rc 0/0 00000100:00100000:3.0:1777580310.846241:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19349 00000100:00100000:3.0:1777580310.846251:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831251065699 time 7831788594140 state 0x2 ref 0 00010000:00010000:3.0:1777580310.857808:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.859994:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.860005:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.860024:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.860030:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.860041:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.860064:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024997a0b00) 00010000:00010000:3.0:1777580310.860068:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.860074:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.860082:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a223 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.865362:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.865414:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946604672 00000100:00100000:2.0:1777580310.865436:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946604672 00000100:00100000:2.0:1777580310.865492:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831251065699 time 7831788594140 state 0x0 ref 1 00000100:00100000:2.0:1777580310.865509:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831788694140 time 7831788594140 state 0x1 ref 1 00000100:00100000:2.0:1777580310.867002:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831788694140 time 7831815854414 state 0x0 ref 1 00000100:00100000:2.0:1777580310.867036:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:282983:x1863919946604672:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580310.867120:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580310.867171:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a22a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e277 expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.867196:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa024185ac100) 00010000:00010000:2.0:1777580310.867207:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580310.867303:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.867320:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.867349:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.867520:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dc38a5f8 reply state 00000000aadffad3 transno 8589950614 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.867531:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580310.867661:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282983:x1863919946604672:12345-192.168.202.9@tcp:36:touch.500 Request processed in 639us (2312us total) trans 8589950614 rc 0/0 00000100:00100000:2.0:1777580310.867671:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19350 00000100:00100000:2.0:1777580310.867678:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831788694140 time 7831815854414 state 0x2 ref 0 00000001:00080000:0.0:1777580310.868630:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938539 is committed 00000001:00080000:0.0:1777580310.868653:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938537 is committed 00000001:00080000:0.0:1777580310.868662:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938529 is committed 00000001:00080000:0.0:1777580310.868744:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938556 is committed 00000001:00080000:0.0:1777580310.868755:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938548 is committed 00000001:00080000:0.0:1777580310.868775:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938540 is committed 00000001:00080000:0.0:1777580310.868832:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938549 is committed 00000001:00080000:0.0:1777580310.868879:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938558 is committed 00000100:00100000:3.0:1777580310.875888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.876060:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946604928 00000100:00100000:3.0:1777580310.876075:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946604928 00000100:00100000:3.0:1777580310.876131:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831788694140 time 7831815854414 state 0x0 ref 1 00000100:00100000:3.0:1777580310.878007:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831815954414 time 7831815854414 state 0x1 ref 1 00000100:00100000:3.0:1777580310.878056:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831815954414 time 7831826917264 state 0x0 ref 1 00000100:00100000:3.0:1777580310.878083:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:282986:x1863919946604928:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.878115:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.878159:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a23f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e27e expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.878376:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.878396:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.878409:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.879175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580310.880653:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.880679:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.880695:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580310.883353:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c6:0x0], index 0: 0 00010000:00010000:3.0:1777580310.887323:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a254 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.887352:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a254 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.887366:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a254 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.887415:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890035:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890046:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890054:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.890060:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890071:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890091:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.890094:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.890100:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890106:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a246 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.890147:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000016b87b28 reply state 0000000005907d9f transno 8589950615 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.890161:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580310.890238:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a23f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e27e expref: 154 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.890260:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a254 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e27e expref: 153 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.893894:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.893910:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.893921:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:3.0:1777580310.894033:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282986:x1863919946604928:12345-192.168.202.9@tcp:101:touch.500 Request processed in 15957us (18153us total) trans 8589950615 rc 0/0 00000100:00100000:3.0:1777580310.894046:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19351 00000100:00100000:3.0:1777580310.894058:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831815954414 time 7831826917264 state 0x2 ref 0 00000100:00100000:3.0:1777580310.894108:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946605056 00000100:00100000:3.0:1777580310.894119:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946605056 00000100:00100000:3.0:1777580310.894168:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831815954414 time 7831826917264 state 0x0 ref 1 00000100:00100000:3.0:1777580310.894183:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831827017264 time 7831826917264 state 0x1 ref 1 00000100:00100000:3.0:1777580310.894206:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831827017264 time 7831843068695 state 0x0 ref 1 00000100:00100000:3.0:1777580310.894219:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:282983:x1863919946605056:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.894249:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.894281:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a262 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e285 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.894355:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a262 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e285 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.894373:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a262 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e285 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.894411:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:3.0:1777580310.894414:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580310.894417:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030a00, rc 0) 00000100:00100000:3.0:1777580310.894972:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:282983:x1863919946605056:12345-192.168.202.9@tcp:101:touch.500 Request processed in 752us (15801us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.894981:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19352 00000100:00100000:3.0:1777580310.894987:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831827017264 time 7831843068695 state 0x2 ref 0 00010000:00010000:3.0:1777580310.895030:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895040:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895047:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895054:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.895060:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895069:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895085:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:3.0:1777580310.895088:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.895092:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.895110:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a238 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910523:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910545:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910553:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910559:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.910564:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910573:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910594:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.910597:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.910602:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.910608:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a24d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.921585:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.926962:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946605312 00000100:00100000:3.0:1777580310.926982:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946605312 00000100:00100000:3.0:1777580310.927033:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831827017264 time 7831843068695 state 0x0 ref 1 00000100:00100000:3.0:1777580310.927067:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831843168695 time 7831843068695 state 0x1 ref 1 00000100:00100000:3.0:1777580310.927101:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831843168695 time 7831875962359 state 0x0 ref 1 00000100:00100000:3.0:1777580310.927118:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:282986:x1863919946605312:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580310.927212:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580310.927247:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a254 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e27e expref: 153 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.927269:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580310.927281:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.927375:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.927392:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.927404:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.928081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.929354:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580310.929414:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946605568 00000100:00100000:2.0:1777580310.929516:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946605568 00000100:00100000:2.0:1777580310.929572:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831876062359 time 7831875962359 state 0x1 ref 2 00000100:00100000:2.0:1777580310.929604:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831876062359 time 7831878467055 state 0x0 ref 2 00000100:00100000:2.0:1777580310.929619:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:282988:x1863919946605568:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580310.929646:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580310.929674:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a270 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e28c expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929866:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929895:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929909:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929929:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929937:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.929944:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.930764:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fe23a7a6 reply state 00000000090c663c transno 8589950616 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.930782:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.930936:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282986:x1863919946605312:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3821us (9364us total) trans 8589950616 rc 0/0 00000100:00100000:3.0:1777580310.930947:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19353 00000100:00100000:3.0:1777580310.931008:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946605696 00000100:00100000:3.0:1777580310.931023:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946605696 00000100:00100000:3.0:1777580310.931068:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11804 00000100:00100000:3.0:1777580310.931077:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946605696:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580310.935600:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946605696:12345-192.168.202.9@tcp:2:touch.500 Request processed in 4507us (6237us total) trans 8589938559 rc 0/0 00000100:00100000:3.0:1777580310.935618:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11804 00000004:00080000:2.0:1777580310.936694:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a2:0x0], index 1: 0 00010000:00010000:2.0:1777580310.936966:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a285 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.936988:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937003:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937049:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937056:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937064:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937086:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.937091:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937098:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937113:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580310.937117:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.937122:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937128:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a277 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580310.937169:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dd21f8e5 reply state 00000000b0466db8 transno 8589950617 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580310.937179:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580310.937226:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a270 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e28c expref: 157 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937242:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a285 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e28c expref: 156 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.937250:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580310.937253:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580310.937255:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1000, rc 0) 00000100:00100000:2.0:1777580310.937348:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:282988:x1863919946605568:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7731us (9270us total) trans 8589950617 rc 0/0 00000100:00100000:2.0:1777580310.937365:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19354 00000100:00100000:2.0:1777580310.937375:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831876062359 time 7831878467055 state 0x2 ref 0 00010000:00010000:0.0:1777580310.942405:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942430:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942446:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942453:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.942459:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942483:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942504:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:0.0:1777580310.942507:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.942512:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.942519:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a269 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.946261:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.946298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.946351:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946605824 00000100:00100000:3.0:1777580310.946364:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946605824 00000100:00100000:3.0:1777580310.946413:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831876062359 time 7831878467055 state 0x0 ref 1 00000100:00100000:3.0:1777580310.946437:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831878567055 time 7831878467055 state 0x1 ref 1 00000100:00100000:3.0:1777580310.946462:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831878567055 time 7831895324293 state 0x0 ref 1 00000100:00100000:3.0:1777580310.946475:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282986:x1863919946605824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.946504:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.946535:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a293 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e293 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946609:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a293 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x806:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e293 expref: 157 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946628:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a293 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x806:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e293 expref: 157 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946650:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59100) 00010000:00010000:3.0:1777580310.946661:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580310.946666:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51c00, rc 0) 00000100:00100000:3.0:1777580310.946729:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:282986:x1863919946605824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 257us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580310.946737:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19355 00000100:00100000:3.0:1777580310.946742:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831878567055 time 7831895324293 state 0x2 ref 0 00010000:00010000:3.0:1777580310.946774:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946783:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946790:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946797:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.946802:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946826:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946838:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02427669000) 00010000:00010000:3.0:1777580310.946850:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.946854:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.946862:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a27e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.948246:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946606080 00000100:00100000:1.0:1777580310.948264:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946606080 00000100:00100000:1.0:1777580310.948336:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4148 00000100:00100000:1.0:1777580310.948348:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+156:282983:x1863919946606080:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580310.952457:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.952564:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580310.952598:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946606336 00000100:00100000:3.0:1777580310.952611:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946606336 00000100:00100000:3.0:1777580310.952660:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831878567055 time 7831895324293 state 0x0 ref 1 00000100:00100000:3.0:1777580310.952676:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831895424293 time 7831895324293 state 0x1 ref 1 00000100:00100000:3.0:1777580310.952696:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946606592 00000100:00100000:3.0:1777580310.952699:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946606592 00000100:00100000:3.0:1777580310.952712:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831895424293 time 7831895324293 state 0x1 ref 2 00000100:00100000:3.0:1777580310.952729:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831901691745 time 7831901591745 state 0x1 ref 2 00000100:00100000:3.0:1777580310.952742:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282988:x1863919946606336:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580310.952821:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580310.952865:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a285 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e28c expref: 159 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.952888:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02427669200) 00010000:00010000:3.0:1777580310.952900:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580310.952988:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953004:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953016:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.953239:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000051817778 reply state 00000000580d715d transno 8589950619 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.953250:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580310.953356:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282988:x1863919946606336:12345-192.168.202.9@tcp:36:touch.500 Request processed in 615us (915us total) trans 8589950619 rc 0/0 00000100:00100000:3.0:1777580310.953364:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19356 00000100:00100000:3.0:1777580310.953392:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831901691745 time 7831902254107 state 0x0 ref 1 00000100:00100000:3.0:1777580310.953403:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:282984:x1863919946606592:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580310.953416:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580310.953428:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a2a1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e29a expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953548:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953561:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953570:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953584:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953592:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.953614:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.954069:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:282983:x1863919946606080:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5720us (7766us total) trans 8589950618 rc 0/0 00000100:00100000:1.0:1777580310.954081:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4148 00000004:00080000:3.0:1777580310.965258:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c7:0x0], index 0: 0 00010000:00010000:3.0:1777580310.967591:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a2b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967620:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967633:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967684:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967692:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967699:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967705:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580310.967710:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967717:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967732:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580310.967735:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580310.967755:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967762:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a2a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580310.967782:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d0e5d7e5 reply state 000000006e60ad8b transno 8589950620 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580310.967794:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580310.967856:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a2a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e29a expref: 161 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967875:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e29a expref: 160 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580310.967883:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:3.0:1777580310.967886:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580310.967889:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030800, rc 0) 00000100:00100000:3.0:1777580310.967982:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282984:x1863919946606592:12345-192.168.202.9@tcp:101:touch.500 Request processed in 14580us (15417us total) trans 8589950620 rc 0/0 00000100:00100000:3.0:1777580310.967993:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19357 00000100:00100000:3.0:1777580310.968003:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831901691745 time 7831902254107 state 0x2 ref 0 00000100:00100000:3.0:1777580310.968113:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580310.968214:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946606720 00000100:00100000:0.0:1777580310.968225:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946606720 00000100:00100000:0.0:1777580310.968294:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11805 00000100:00100000:0.0:1777580310.968304:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2364:x1863919946606720:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580310.968856:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+46:2364:x1863919946606720:12345-192.168.202.9@tcp:2:touch.500 Request processed in 541us (731us total) trans 8589938960 rc 0/0 00000100:00100000:0.0:1777580310.968864:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11805 00010000:00010000:0.0:1777580310.976714:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.976736:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.976745:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.976753:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.976759:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.976779:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.976802:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02484c59800) 00010000:00010000:0.0:1777580310.976806:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.977953:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.977972:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a29a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777580310.978385:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938944 is committed 00000001:00080000:0.0:1777580310.978402:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938937 is committed 00000001:00080000:0.0:1777580310.978412:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938935 is committed 00000001:00080000:0.0:1777580310.978622:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938957 is committed 00000001:00080000:0.0:1777580310.978629:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938950 is committed 00000001:00080000:0.0:1777580310.978724:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938959 is committed 00000100:00100000:0.0:1777580310.985970:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580310.985997:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580310.986100:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580310.986131:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946606976 00000100:00100000:0.0:1777580310.986163:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946606976 00000100:00100000:1.0:1777580310.986187:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946607232 00000100:00100000:1.0:1777580310.986192:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946607232 00000100:00100000:0.0:1777580310.986212:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831901691745 time 7831902254107 state 0x0 ref 1 00000100:00100000:1.0:1777580310.986219:0:187630:0:(nrs_tbf.c:531:nrs_tbf_cli_fini()) unknown.0 NRS: TBF class fini: class@ffffa024b6266900 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 7831935079268 state 0x4 ref 0 00000100:00100000:0.0:1777580310.986227:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831902354107 time 7831902254107 state 0x1 ref 2 00000100:00100000:1.0:1777580310.986233:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831902354107 time 7831902254107 state 0x1 ref 2 00000100:00100000:0.0:1777580310.986246:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946607360 00000100:00100000:0.0:1777580310.986249:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946607360 00000100:00100000:0.0:1777580310.986260:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831902354107 time 7831902254107 state 0x1 ref 3 00000100:00100000:1.0:1777580310.986322:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935283362 time 7831935183362 state 0x1 ref 3 00000100:00100000:1.0:1777580310.986336:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+162:282984:x1863919946606976:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580310.986410:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580310.986445:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a2b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e29a expref: 162 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.986468:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:1.0:1777580310.986488:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580310.986583:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.986599:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.986611:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580310.986654:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935616642 time 7831935516642 state 0x1 ref 3 00000100:00100000:0.0:1777580310.986664:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:282990:x1863919946607232:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580310.986675:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580310.986689:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a2cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2a1 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580310.986785:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000083cb7c13 reply state 0000000083f45ee9 transno 8589950621 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.986795:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580310.986804:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580310.986917:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282984:x1863919946606976:12345-192.168.202.9@tcp:36:touch.500 Request processed in 583us (960us total) trans 8589950621 rc 0/0 00000100:00100000:1.0:1777580310.986925:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19358 00000100:00100000:1.0:1777580310.986949:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935616642 time 7831935811926 state 0x0 ref 2 00000100:00100000:1.0:1777580310.986958:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:282988:x1863919946607360:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580310.986966:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580310.986977:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a2d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2a8 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.987008:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x807:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a8 expref: 164 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.987016:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.987021:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x807:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a8 expref: 164 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.987024:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.987039:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.987045:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.987051:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580310.987052:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02486090600) 00010000:00010000:1.0:1777580310.987055:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580310.987058:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839000, rc 0) 00000100:00100000:1.0:1777580310.987081:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282988:x1863919946607360:12345-192.168.202.9@tcp:101:touch.500 Request processed in 123us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580310.987086:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19360 00010000:00010000:2.0:1777580310.987476:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987487:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987494:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987501:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580310.987506:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987514:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987526:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02484c59e00) 00010000:00010000:2.0:1777580310.987529:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580310.987533:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580310.987539:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a2af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580310.989957:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a3:0x0], index 1: 0 00010000:00010000:0.0:1777580310.991251:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a2e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991277:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991306:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991353:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991361:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991369:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991375:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.991379:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991387:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991400:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580310.991403:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.991407:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.991414:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a2d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580310.994228:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000735c4386 reply state 00000000cda31349 transno 8589950622 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580310.994254:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580310.994344:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a2cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a1 expref: 164 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.994365:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a1 expref: 163 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.994375:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02499549300) 00010000:00010000:0.0:1777580310.994378:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580310.994382:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f200, rc 0) 00000100:00100000:0.0:1777580310.994500:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282990:x1863919946607232:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7835us (8500us total) trans 8589950622 rc 0/0 00000100:00100000:0.0:1777580310.994511:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19359 00000100:00100000:0.0:1777580310.994520:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935616642 time 7831935811926 state 0x2 ref 0 00010000:00010000:0.0:1777580310.997808:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997832:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997849:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997856:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580310.997862:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997870:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997891:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02486090400) 00010000:00010000:0.0:1777580310.997916:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580310.997922:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580310.997930:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a2c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.007526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.007617:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.016512:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946607488 00000100:00100000:3.0:1777580311.016533:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946607488 00000100:00100000:3.0:1777580311.016611:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935616642 time 7831935811926 state 0x0 ref 1 00000100:00100000:3.0:1777580311.016628:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935911926 time 7831935811926 state 0x1 ref 1 00000100:00100000:3.0:1777580311.016675:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935911926 time 7831965536907 state 0x0 ref 1 00000100:00100000:3.0:1777580311.016694:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:282984:x1863919946607488:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.016726:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.016757:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a2f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2af expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.016998:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x808:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2af expref: 164 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.017019:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x808:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2af expref: 164 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.017045:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580311.017048:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.017053:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248c032800, rc 0) 00000100:00100000:3.0:1777580311.017161:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282984:x1863919946607488:12345-192.168.202.9@tcp:101:touch.500 Request processed in 449us (9627us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.017171:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19361 00000100:00100000:3.0:1777580311.017177:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935911926 time 7831965536907 state 0x2 ref 0 00000100:00100000:3.0:1777580311.017217:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946607744 00000100:00100000:3.0:1777580311.017224:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946607744 00000100:00100000:3.0:1777580311.017266:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4149 00000100:00100000:3.0:1777580311.017274:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282986:x1863919946607744:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580311.017734:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+165:282986:x1863919946607744:12345-192.168.202.9@tcp:35:touch.500 Request processed in 459us (10115us total) trans 8589950623 rc 0/0 00000100:00100000:3.0:1777580311.017751:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4149 00010000:00010000:2.0:1777580311.017974:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.017985:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.018000:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.018006:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.018011:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.018020:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.018034:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024993dfa00) 00010000:00010000:2.0:1777580311.018037:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.018040:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.018046:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a2e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.019966:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.020062:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:1.0:1777580311.020185:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580311.020586:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.024579:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946608000 00000100:00100000:1.0:1777580311.024599:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946608000 00000100:00100000:1.0:1777580311.024659:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831935911926 time 7831965536907 state 0x0 ref 1 00000100:00100000:1.0:1777580311.024676:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831965636907 time 7831965536907 state 0x1 ref 1 00000100:00100000:1.0:1777580311.024705:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946608256 00000100:00100000:1.0:1777580311.024709:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946608256 00000100:00100000:1.0:1777580311.024721:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831965636907 time 7831965536907 state 0x1 ref 2 00000100:00100000:1.0:1777580311.024751:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831973712847 time 7831973612847 state 0x1 ref 2 00000100:00100000:1.0:1777580311.024771:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+165:282990:x1863919946608000:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580311.024874:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.024909:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a2e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a1 expref: 165 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.024937:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02499549300) 00010000:00010000:1.0:1777580311.024969:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580311.025064:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.025080:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.025093:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.025157:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831973712847 time 7831973997729 state 0x0 ref 2 00000100:00100000:0.0:1777580311.025172:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:282992:x1863919946608256:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.025183:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.025195:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a303 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2b6 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580311.025292:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000543bd09c reply state 000000001496b545 transno 8589950624 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.025302:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580311.025438:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:282990:x1863919946608000:12345-192.168.202.9@tcp:36:touch.500 Request processed in 674us (5484us total) trans 8589950624 rc 0/0 00000100:00100000:1.0:1777580311.025446:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19362 00010000:00010000:0.0:1777580311.027768:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.027798:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.027812:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.027833:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.027850:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.027857:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580311.029902:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c8:0x0], index 0: 0 00010000:00010000:0.0:1777580311.030162:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a318 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.030181:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a318 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.030194:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a318 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.030240:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.030243:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946608384 00000100:00100000:3.0:1777580311.030256:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946608384 00000100:00100000:1.0:1777580311.030631:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.031542:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031552:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031559:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.031564:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031574:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031592:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.031595:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.031600:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031623:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a30a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.031649:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dba1a0c2 reply state 00000000d3d2a397 transno 8589950625 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.031660:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580311.031720:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a303 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2b6 expref: 168 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031739:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a318 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2b6 expref: 167 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031747:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02499549700) 00010000:00010000:0.0:1777580311.031750:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580311.031753:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:0.0:1777580311.031859:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+168:282992:x1863919946608256:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6690us (11795us total) trans 8589950625 rc 0/0 00000100:00100000:0.0:1777580311.031871:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19363 00000100:00100000:0.0:1777580311.031881:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831973712847 time 7831973997729 state 0x2 ref 0 00010000:00010000:0.0:1777580311.031937:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031946:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031952:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031967:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.031970:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031976:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031985:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02486090100) 00010000:00010000:0.0:1777580311.031988:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.031991:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.031997:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a2fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.032224:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946608512 00000100:00100000:3.0:1777580311.032233:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946608512 00000100:00100000:3.0:1777580311.032269:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11806 00000100:00100000:3.0:1777580311.032280:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946608384:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580311.032562:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11807 00000100:00100000:1.0:1777580311.032572:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2361:x1863919946608512:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.033217:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946608384:12345-192.168.202.9@tcp:2:touch.500 Request processed in 937us (12628us total) trans 8589938560 rc 0/0 00000100:00100000:3.0:1777580311.033226:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11806 00000100:00100000:1.0:1777580311.035683:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946608512:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3095us (5041us total) trans 8589938961 rc 0/0 00000100:00100000:1.0:1777580311.035699:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11807 00010000:00010000:3.0:1777580311.039946:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.039970:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.039980:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.039987:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.039993:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.040003:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.040043:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02499549a00) 00010000:00010000:3.0:1777580311.040046:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.040052:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.040060:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a311 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.048800:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.048868:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.048901:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.049060:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946608768 00000100:00100000:1.0:1777580311.049074:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946608768 00000100:00100000:1.0:1777580311.049210:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4150 00000100:00100000:1.0:1777580311.049223:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+166:282988:x1863919946608768:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.050682:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:282988:x1863919946608768:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1452us (1886us total) trans 8589950626 rc 0/0 00000100:00100000:1.0:1777580311.050711:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4150 00000100:00100000:2.0:1777580311.051006:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.054053:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946609024 00000100:00100000:0.0:1777580311.054074:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946609024 00000100:00100000:0.0:1777580311.054153:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831973712847 time 7831973997729 state 0x0 ref 1 00000100:00100000:0.0:1777580311.054171:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831974097729 time 7831973997729 state 0x1 ref 1 00000100:00100000:0.0:1777580311.054206:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946609280 00000100:00100000:0.0:1777580311.054210:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946609280 00000100:00100000:0.0:1777580311.054224:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831974097729 time 7831973997729 state 0x1 ref 2 00000100:00100000:0.0:1777580311.054248:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832003210727 time 7832003110727 state 0x1 ref 2 00000100:00100000:0.0:1777580311.054266:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+168:282992:x1863919946609024:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.054343:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.054396:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a318 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2b6 expref: 168 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.054424:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02499549700) 00010000:00010000:0.0:1777580311.058960:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.059107:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059148:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059163:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.059359:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a3551ede reply state 0000000002d58e34 transno 8589950627 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.059371:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.059518:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+169:282992:x1863919946609024:12345-192.168.202.9@tcp:36:touch.500 Request processed in 5253us (10643us total) trans 8589950627 rc 0/0 00000100:00100000:0.0:1777580311.059529:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19364 00000100:00100000:0.0:1777580311.059571:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832003210727 time 7832008431304 state 0x0 ref 1 00000100:00100000:0.0:1777580311.059588:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+168:282995:x1863919946609280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.059608:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.059622:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a32d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2bd expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059762:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059789:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059797:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059813:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059821:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.059828:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580311.060427:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a4:0x0], index 1: 0 00010000:00010000:0.0:1777580311.060617:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a342 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060631:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060640:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060678:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060686:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060693:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060707:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.060712:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060720:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060734:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.060737:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.060741:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060747:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a334 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.060765:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021cfadcf reply state 00000000d8d600c8 transno 8589950628 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.060772:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580311.060809:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a32d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2bd expref: 171 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060825:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a342 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2bd expref: 170 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.060833:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:0.0:1777580311.060836:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580311.060838:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:0.0:1777580311.060921:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+171:282995:x1863919946609280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1338us (12018us total) trans 8589950628 rc 0/0 00000100:00100000:0.0:1777580311.060936:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19365 00000100:00100000:0.0:1777580311.060944:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832003210727 time 7832008431304 state 0x2 ref 0 00000100:00100000:2.0:1777580311.077684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.077763:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.078296:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.082763:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946609536 00000100:00100000:3.0:1777580311.082787:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946609536 00000100:00100000:3.0:1777580311.082983:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4151 00000100:00100000:3.0:1777580311.082996:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+171:282984:x1863919946609536:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580311.084564:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946609664 00000100:00100000:3.0:1777580311.084579:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946609664 00000100:00100000:3.0:1777580311.084626:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832003210727 time 7832008431304 state 0x0 ref 1 00000100:00100000:3.0:1777580311.084643:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832008531304 time 7832008431304 state 0x1 ref 1 00000100:00100000:3.0:1777580311.084859:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946609792 00000100:00100000:3.0:1777580311.084864:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946609792 00000100:00100000:3.0:1777580311.084882:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832008531304 time 7832008431304 state 0x1 ref 2 00000100:00100000:0.0:1777580311.088334:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.100663:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100685:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100694:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100701:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.100708:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100718:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100744:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02499549300) 00010000:00010000:0.0:1777580311.100748:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.100754:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.100761:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a326 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.108172:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610048 00000100:00100000:2.0:1777580311.108192:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610048 00000100:00100000:2.0:1777580311.108264:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832008531304 time 7832008431304 state 0x1 ref 3 00000100:00100000:2.0:1777580311.108327:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610304 00000100:00100000:2.0:1777580311.108347:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610304 00000100:00100000:2.0:1777580311.108365:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832008531304 time 7832008431304 state 0x1 ref 4 00000100:00100000:2.0:1777580311.108383:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057345269 time 7832057245269 state 0x1 ref 4 00000100:00100000:2.0:1777580311.108400:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282990:x1863919946609664:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.108507:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.108540:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a350 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2c4 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108620:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x809:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2c4 expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108637:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x809:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2c4 expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108661:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02427669b00) 00010000:00010000:2.0:1777580311.108665:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580311.108669:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1400, rc 0) 00000100:00100000:2.0:1777580311.108757:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:282990:x1863919946609664:12345-192.168.202.9@tcp:101:touch.500 Request processed in 362us (31090us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.108764:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19366 00000100:00100000:2.0:1777580311.108790:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057753495 time 7832057653495 state 0x1 ref 3 00000100:00100000:2.0:1777580311.108800:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282992:x1863919946609792:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.108915:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.108928:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a357 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2cb expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108964:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a357 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2cb expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108975:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a357 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2cb expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.108986:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580311.108988:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580311.108991:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0c00, rc 0) 00000100:00100000:2.0:1777580311.109010:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:282992:x1863919946609792:12345-192.168.202.9@tcp:101:touch.500 Request processed in 212us (31248us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.109017:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19367 00000100:00100000:2.0:1777580311.109032:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057995717 time 7832057895717 state 0x1 ref 2 00000100:00100000:2.0:1777580311.109041:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282995:x1863919946610048:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580311.109089:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.109111:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a342 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2bd expref: 175 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.109130:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:2.0:1777580311.109166:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.109232:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.109242:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.109261:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.110721:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009b780e3c reply state 000000004d1084a3 transno 8589950630 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.110741:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580311.111631:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:282995:x1863919946610048:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2579us (33326us total) trans 8589950630 rc 0/0 00000100:00100000:2.0:1777580311.111643:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19368 00000100:00100000:2.0:1777580311.111703:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057995717 time 7832060562931 state 0x0 ref 1 00000100:00100000:2.0:1777580311.111721:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282997:x1863919946610304:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.111743:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.111767:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a365 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2d2 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113705:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113732:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113747:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113766:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113788:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.113796:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.116750:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.119635:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119660:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119670:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119694:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.119701:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119710:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119733:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580311.119737:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.119744:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.119751:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a33b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.120009:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282984:x1863919946609536:12345-192.168.202.9@tcp:35:touch.500 Request processed in 37007us (68995us total) trans 8589950629 rc 0/0 00000100:00100000:3.0:1777580311.120024:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4151 00000004:00080000:2.0:1777580311.120313:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c9:0x0], index 0: 0 00010000:00010000:2.0:1777580311.123596:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a37a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123626:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123642:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123716:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123724:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123731:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123738:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.123742:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123750:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123779:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.123783:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.123788:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.123795:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a36c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.124950:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000afa2312a reply state 000000007b6ab2c4 transno 8589950631 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.124967:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.125041:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a365 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d2 expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.125064:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a37a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d2 expref: 175 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.125073:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580311.125076:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.125079:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69be400, rc 0) 00000100:00100000:2.0:1777580311.125183:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:282997:x1863919946610304:12345-192.168.202.9@tcp:101:touch.500 Request processed in 13466us (36860us total) trans 8589950631 rc 0/0 00000100:00100000:2.0:1777580311.125194:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19369 00000100:00100000:2.0:1777580311.125204:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057995717 time 7832060562931 state 0x2 ref 0 00000100:00100000:0.0:1777580311.150328:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.150372:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610560 00000100:00100000:0.0:1777580311.150392:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610560 00000100:00100000:0.0:1777580311.150463:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11808 00000100:00100000:0.0:1777580311.150475:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946610560:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.150907:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946610560:12345-192.168.202.9@tcp:2:touch.500 Request processed in 433us (590us total) trans 8589938962 rc 0/0 00000100:00100000:0.0:1777580311.150917:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11808 00000100:00100000:0.0:1777580311.167084:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.167240:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167256:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167266:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167273:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.167279:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167288:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167309:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02427669000) 00010000:00010000:0.0:1777580311.167312:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.167318:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.167325:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a35e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.167702:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610432 00000100:00100000:2.0:1777580311.167715:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610432 00000100:00100000:2.0:1777580311.167800:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11809 00000100:00100000:2.0:1777580311.167822:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946610432:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580311.168288:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946610432:12345-192.168.202.9@tcp:2:touch.500 Request processed in 478us (1218us total) trans 8589938561 rc 0/0 00000100:00100000:2.0:1777580311.168297:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11809 00010000:00010000:3.0:1777580311.168611:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168623:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168630:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168637:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.168642:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168659:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168674:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024993dfa00) 00010000:00010000:3.0:1777580311.168677:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.168681:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.168687:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a373 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.190073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.190122:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.190257:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.190304:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610688 00000100:00100000:1.0:1777580311.190317:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610688 00000100:00100000:1.0:1777580311.190370:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832057995717 time 7832060562931 state 0x0 ref 1 00000100:00100000:1.0:1777580311.190386:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832060662931 time 7832060562931 state 0x1 ref 1 00000100:00100000:1.0:1777580311.190408:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946611200 00000100:00100000:1.0:1777580311.190411:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946611200 00000100:00100000:1.0:1777580311.190424:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832060662931 time 7832060562931 state 0x1 ref 2 00000100:00100000:1.0:1777580311.190444:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832139406196 time 7832139306196 state 0x1 ref 2 00000100:00100000:1.0:1777580311.190456:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:282995:x1863919946610688:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580311.190483:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.190517:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a388 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2d9 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.190593:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a388 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d9 expref: 176 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.190613:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a388 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d9 expref: 176 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.190635:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02486090900) 00010000:00010000:1.0:1777580311.190652:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580311.190657:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839e00, rc 0) 00000100:00100000:3.0:1777580311.191363:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832139406196 time 7832140221057 state 0x0 ref 2 00000100:00100000:3.0:1777580311.191387:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:282997:x1863919946611200:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580311.191456:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.191483:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4a37a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d2 expref: 176 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.191500:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02488b77500) 00010000:00010000:3.0:1777580311.191509:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580311.191588:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.191600:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.191610:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.191802:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed2ef117 reply state 000000006e4e0646 transno 8589950632 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.191828:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580311.193167:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+177:282995:x1863919946610688:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2697us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.193182:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19370 00000100:00100000:1.0:1777580311.193252:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946610944 00000100:00100000:1.0:1777580311.193262:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946610944 00000100:00100000:3.0:1777580311.194173:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+177:282997:x1863919946611200:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2787us (3908us total) trans 8589950632 rc 0/0 00000100:00100000:3.0:1777580311.194185:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19371 00000100:00100000:3.0:1777580311.194194:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832139406196 time 7832140221057 state 0x2 ref 0 00000100:00100000:3.0:1777580311.194376:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.195023:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.195118:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946611712 00000100:00100000:3.0:1777580311.195127:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946611712 00000100:00100000:3.0:1777580311.195254:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4152 00000100:00100000:3.0:1777580311.195264:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+177:282992:x1863919946611712:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.195434:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4153 00000100:00100000:1.0:1777580311.195443:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+177:282990:x1863919946610944:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.195877:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:282990:x1863919946610944:12345-192.168.202.9@tcp:35:touch.500 Request processed in 433us (5751us total) trans 8589950633 rc 0/0 00000100:00100000:1.0:1777580311.195885:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4153 00000100:00100000:3.0:1777580311.200680:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:282992:x1863919946611712:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5403us (5645us total) trans 8589950634 rc 0/0 00000100:00100000:3.0:1777580311.200696:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4152 00000100:00100000:2.0:1777580311.202536:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946611456 00000100:00100000:2.0:1777580311.202556:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946611456 00000100:00100000:2.0:1777580311.202614:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832139406196 time 7832140221057 state 0x0 ref 1 00000100:00100000:2.0:1777580311.202631:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832140321057 time 7832140221057 state 0x1 ref 1 00000100:00100000:2.0:1777580311.202670:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832140321057 time 7832151532193 state 0x0 ref 1 00000100:00100000:2.0:1777580311.202689:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:282998:x1863919946611456:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.202715:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.202743:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a396 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2e0 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.202944:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.202963:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.202976:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.202994:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203023:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203031:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.203672:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a5:0x0], index 1: 0 00010000:00010000:2.0:1777580311.203901:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a3ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203916:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a3ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203926:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a3ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203970:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203978:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203984:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.203991:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.203995:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.204004:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.204030:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.204033:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.204039:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.204046:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4a39d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.204062:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b0c1ce98 reply state 0000000056645471 transno 8589950635 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.204072:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.204113:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4a396 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e0 expref: 181 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.204129:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a3ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e0 expref: 180 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.204168:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580311.204170:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.204173:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0000, rc 0) 00000100:00100000:2.0:1777580311.204275:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:282998:x1863919946611456:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1592us (9898us total) trans 8589950635 rc 0/0 00000100:00100000:2.0:1777580311.204285:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19372 00000100:00100000:2.0:1777580311.204293:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832140321057 time 7832151532193 state 0x2 ref 0 00010000:00010000:1.0:1777580311.206074:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206093:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206102:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206109:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.206114:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206122:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206178:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:1.0:1777580311.206198:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.206204:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.206210:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a38f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.207580:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.207680:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.207713:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946611968 00000100:00100000:3.0:1777580311.207724:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946611968 00000100:00100000:3.0:1777580311.207772:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832140321057 time 7832151532193 state 0x0 ref 1 00000100:00100000:3.0:1777580311.207788:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832151632193 time 7832151532193 state 0x1 ref 1 00000100:00100000:3.0:1777580311.207822:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832151632193 time 7832156683364 state 0x0 ref 1 00000100:00100000:3.0:1777580311.207861:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+180:282997:x1863919946611968:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.207893:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.207920:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a3b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2e7 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.207988:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a3b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e7 expref: 181 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.208005:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a3b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e7 expref: 181 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.208026:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580311.208029:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.208033:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fe00, rc 0) 00000100:00100000:3.0:1777580311.208102:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:282997:x1863919946611968:12345-192.168.202.9@tcp:101:touch.500 Request processed in 244us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.208110:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19373 00000100:00100000:3.0:1777580311.208117:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832151632193 time 7832156683364 state 0x2 ref 0 00000100:00100000:3.0:1777580311.208178:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946611840 00000100:00100000:3.0:1777580311.208182:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946611840 00000100:00100000:3.0:1777580311.208212:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11810 00000100:00100000:3.0:1777580311.208219:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946611840:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.208561:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946611840:12345-192.168.202.9@tcp:2:touch.500 Request processed in 341us (880us total) trans 8589938562 rc 0/0 00000100:00100000:3.0:1777580311.208568:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11810 00010000:00010000:3.0:1777580311.210503:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210523:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210532:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210538:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.210544:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210552:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210571:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02488b77a00) 00010000:00010000:3.0:1777580311.210574:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.210580:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.210587:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4a3a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.217414:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217454:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217521:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217543:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217562:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.217626:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612224 00000100:00100000:3.0:1777580311.217646:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612224 00000100:00100000:3.0:1777580311.217696:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832151632193 time 7832156683364 state 0x0 ref 1 00000100:00100000:3.0:1777580311.217713:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832156783364 time 7832156683364 state 0x1 ref 1 00000100:00100000:3.0:1777580311.217734:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612352 00000100:00100000:3.0:1777580311.217737:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612352 00000100:00100000:3.0:1777580311.217750:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831632167245 time 7831667256024 state 0x0 ref 1 00000100:00100000:3.0:1777580311.217756:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831667356024 time 7831667256024 state 0x1 ref 1 00000100:00100000:3.0:1777580311.217762:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612480 00000100:00100000:3.0:1777580311.217765:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612480 00000100:00100000:3.0:1777580311.217778:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7831667356024 time 7831667256024 state 0x1 ref 2 00000100:00100000:3.0:1777580311.217788:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832166750698 time 7832166650698 state 0x1 ref 2 00000100:00100000:3.0:1777580311.217798:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283012:x1863919946612352:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580311.217832:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777580311.217974:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612608 00000100:00100000:1.0:1777580311.217979:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612608 00000100:00100000:1.0:1777580311.217998:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832166750698 time 7832166650698 state 0x1 ref 3 00000100:00100000:1.0:1777580311.218007:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612736 00000100:00100000:1.0:1777580311.218010:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612736 00000100:00100000:1.0:1777580311.218019:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832166750698 time 7832166650698 state 0x1 ref 4 00000100:00100000:1.0:1777580311.218025:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612864 00000100:00100000:1.0:1777580311.218028:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612864 00000100:00100000:1.0:1777580311.218035:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832166750698 time 7832166650698 state 0x1 ref 5 00000100:00100000:1.0:1777580311.218044:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832156783364 time 7832166907835 state 0x0 ref 1 00000100:00100000:1.0:1777580311.218053:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:282998:x1863919946612224:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580311.218106:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.218156:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a3ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e0 expref: 185 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.218178:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02488b77800) 00010000:00010000:1.0:1777580311.218192:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580311.218287:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.218319:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.218331:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580311.218509:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d123ee18 reply state 00000000d9e15462 transno 8589950636 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.218519:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580311.218637:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:282998:x1863919946612224:12345-192.168.202.9@tcp:36:touch.500 Request processed in 583us (1235us total) trans 8589950636 rc 0/0 00000100:00100000:1.0:1777580311.218647:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19374 00000100:00100000:1.0:1777580311.218653:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832156783364 time 7832166907835 state 0x2 ref 0 00000100:00100000:1.0:1777580311.218681:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832167644470 time 7832167544470 state 0x1 ref 5 00000100:00100000:1.0:1777580311.218693:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283007:x1863919946612480:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.218703:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.220898:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a3c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2ee expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221005:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221023:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221037:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221082:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221091:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221099:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221282:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221307:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221315:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580311.221351:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x807:0x0]: returning size 0 00000004:00200000:3.0:1777580311.221357:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580311.221383:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221398:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221408:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221416:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221435:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221443:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.221448:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221457:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221472:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580311.221475:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.221481:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221489:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a3ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221504:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221510:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221516:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221521:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.221524:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221541:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221550:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024993dfa00) 00010000:00010000:3.0:1777580311.221553:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.221556:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221562:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a3d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221603:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a3c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2ee expref: 187 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221617:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2ee expref: 186 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.221623:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02486090600) 00010000:00010000:3.0:1777580311.221626:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580311.221628:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:3.0:1777580311.221705:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283012:x1863919946612352:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3907us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.221717:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19375 00000100:00100000:3.0:1777580311.221765:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832170725786 time 7832170625786 state 0x1 ref 4 00000100:00100000:3.0:1777580311.221782:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283023:x1863919946612608:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580311.221800:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1777580311.222178:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832171138667 time 7832171038667 state 0x1 ref 4 00000100:00100000:2.0:1777580311.222202:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283003:x1863919946612736:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.222212:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.224545:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a3e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2f5 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224656:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224674:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224687:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224721:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224727:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224733:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224892:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224901:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224909:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.224943:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x806:0x0]: returning size 0 00000004:00200000:1.0:1777580311.224947:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.224971:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224985:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224993:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.224999:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225016:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225023:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.225027:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225035:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225049:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.225052:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.225057:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225064:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a3ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225081:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225088:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225094:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225099:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.225102:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225122:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225130:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02486090400) 00010000:00010000:1.0:1777580311.225132:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.225164:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225170:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a3f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225213:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a3e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2f5 expref: 187 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225229:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2f5 expref: 186 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.225237:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580311.225239:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.225241:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839800, rc 0) 00000100:00100000:1.0:1777580311.227782:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283007:x1863919946612480:12345-192.168.202.9@tcp:101:rm.500 Request processed in 9073us (10242us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.227800:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19376 00000100:00100000:1.0:1777580311.227867:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832171138667 time 7832176725512 state 0x0 ref 3 00000100:00100000:1.0:1777580311.227891:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283022:x1863919946612864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.227916:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.227961:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a3ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e30a expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228046:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228063:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228077:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228097:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228105:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228111:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228294:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228304:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228311:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.228344:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x808:0x0]: returning size 0 00000004:00200000:1.0:1777580311.228349:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.228372:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228393:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228402:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228410:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228417:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228424:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.228428:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228436:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228449:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.228452:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.228456:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228463:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a406 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228477:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228483:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228495:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228501:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.228504:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228510:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228518:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580311.228520:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.228523:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228529:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a40d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228571:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a3ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e30a expref: 187 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228585:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e30a expref: 186 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.228593:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:1.0:1777580311.228596:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.228599:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:1.0:1777580311.236719:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283022:x1863919946612864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 8816us (19103us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.236759:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19379 00000100:00100000:0.0:1777580311.252281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.252406:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580311.252570:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a41b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e2fc expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252674:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252693:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252708:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252730:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252737:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252744:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252906:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252916:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.252923:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580311.252958:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x809:0x0]: returning size 0 00000004:00200000:3.0:1777580311.252963:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580311.252987:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253019:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253029:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253036:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253042:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253049:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.253053:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253061:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253074:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580311.253078:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.253083:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253090:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a422 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253106:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253112:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253124:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253129:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.253131:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253171:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253180:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580311.253182:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.253185:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253191:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a429 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253232:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a41b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2fc expref: 187 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253249:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2fc expref: 186 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.253257:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02427669b00) 00010000:00010000:3.0:1777580311.253260:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580311.253263:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030800, rc 0) 00000100:00100000:3.0:1777580311.253343:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283023:x1863919946612608:12345-192.168.202.9@tcp:101:rm.500 Request processed in 31566us (35798us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.253362:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19377 00000100:00100000:3.0:1777580311.253778:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946612992 00000100:00100000:3.0:1777580311.253789:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946612992 00000100:00100000:3.0:1777580311.253856:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11811 00000100:00100000:3.0:1777580311.253866:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946612992:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.254277:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946612992:12345-192.168.202.9@tcp:2:touch.500 Request processed in 411us (2011us total) trans 8589938963 rc 0/0 00000100:00100000:3.0:1777580311.254285:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11811 00010000:00010000:2.0:1777580311.259485:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a437 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e303 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259600:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259620:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259634:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259656:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259664:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259671:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259833:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259851:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259859:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.259916:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x805:0x0]: returning size 0 00000004:00200000:2.0:1777580311.259921:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.259947:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259961:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259970:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259976:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259983:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.259990:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.259994:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260002:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260026:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.260030:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.260035:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260042:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a43e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260070:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260076:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260081:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260086:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.260089:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260095:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260102:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02488b77200) 00010000:00010000:2.0:1777580311.260104:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.260106:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260111:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a445 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260166:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a437 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 187 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260182:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 186 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.260199:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580311.260202:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.260205:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:2.0:1777580311.260296:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283003:x1863919946612736:12345-192.168.202.9@tcp:101:rm.500 Request processed in 38095us (42731us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.260307:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19378 00000100:00100000:2.0:1777580311.260316:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832171138667 time 7832176725512 state 0x2 ref 0 00000100:00100000:0.0:1777580311.260494:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.260526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.260560:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.260580:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.260600:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.260725:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613504 00000100:00100000:0.0:1777580311.260735:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613504 00000100:00100000:0.0:1777580311.260782:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613632 00000100:00100000:0.0:1777580311.260785:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613632 00000100:00100000:0.0:1777580311.260804:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613760 00000100:00100000:0.0:1777580311.260807:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613760 00000100:00100000:0.0:1777580311.260821:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613888 00000100:00100000:0.0:1777580311.260824:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613888 00000100:00100000:0.0:1777580311.260857:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11812 00000100:00100000:0.0:1777580311.260867:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946613504:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.260887:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.260911:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e318 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.260944:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a2:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.260964:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.260966:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.260976:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.260993:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261015:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20800, rc 0) 00000100:00100000:0.0:1777580311.261050:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2362:x1863919946613504:12345-192.168.202.9@tcp:101:rm.500 Request processed in 186us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.261058:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11812 00000100:00100000:0.0:1777580311.261076:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11813 00000100:00100000:0.0:1777580311.261083:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2363:x1863919946613632:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.261091:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.261103:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e31f expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.261121:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c7:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.261131:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261161:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261166:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261180:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261189:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6400, rc 0) 00000100:00100000:0.0:1777580311.261209:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2363:x1863919946613632:12345-192.168.202.9@tcp:101:rm.500 Request processed in 127us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.261215:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11813 00000100:00100000:0.0:1777580311.261229:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11814 00000100:00100000:0.0:1777580311.261241:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2363:x1863919946613760:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.261249:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.261260:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e326 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.261275:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a3:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.261284:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261286:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261291:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261302:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261311:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6800, rc 0) 00000100:00100000:0.0:1777580311.261330:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2363:x1863919946613760:12345-192.168.202.9@tcp:101:rm.500 Request processed in 91us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.261337:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11814 00000100:00100000:0.0:1777580311.261350:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11815 00000100:00100000:0.0:1777580311.261356:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946613888:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.261363:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.261376:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e32d expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.261388:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c6:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.261397:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261403:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.261408:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261420:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 31 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.261430:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6200, rc 0) 00000100:00100000:0.0:1777580311.261450:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946613888:12345-192.168.202.9@tcp:101:rm.500 Request processed in 95us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.261456:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11815 00000100:00100000:1.0:1777580311.261811:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613248 00000100:00100000:1.0:1777580311.261820:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613248 00000100:00100000:1.0:1777580311.261916:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4154 00000100:00100000:1.0:1777580311.261926:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:282995:x1863919946613248:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.262369:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:282995:x1863919946613248:12345-192.168.202.9@tcp:35:touch.500 Request processed in 445us (9962us total) trans 8589950637 rc 0/0 00000100:00100000:1.0:1777580311.262379:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4154 00000100:00100000:0.0:1777580311.266516:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946613376 00000100:00100000:0.0:1777580311.266536:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946613376 00000100:00100000:0.0:1777580311.266593:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832156783364 time 7832166907835 state 0x0 ref 1 00000100:00100000:0.0:1777580311.266611:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832167007835 time 7832166907835 state 0x1 ref 1 00000100:00100000:0.0:1777580311.266646:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832167007835 time 7832215507786 state 0x0 ref 1 00000100:00100000:0.0:1777580311.266665:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:282998:x1863919946613376:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.266696:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.266725:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4a46f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e311 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.266805:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4a46f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e311 expref: 188 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.266837:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4a46f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e311 expref: 188 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.266888:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:0.0:1777580311.266891:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580311.266895:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6000, rc 0) 00000100:00100000:0.0:1777580311.266975:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:282998:x1863919946613376:12345-192.168.202.9@tcp:101:touch.500 Request processed in 318us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.266984:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19380 00000100:00100000:0.0:1777580311.266989:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832167007835 time 7832215507786 state 0x2 ref 0 00010000:00010000:0.0:1777580311.267029:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267038:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267044:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267051:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.267056:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267064:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267076:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:0.0:1777580311.267078:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.267082:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.267097:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a3c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.271933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.271984:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946614144 00000100:00100000:3.0:1777580311.271998:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946614144 00000100:00100000:3.0:1777580311.272067:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4155 00000100:00100000:3.0:1777580311.272080:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:282997:x1863919946614144:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580311.278224:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:282997:x1863919946614144:12345-192.168.202.9@tcp:35:touch.500 Request processed in 6130us (6295us total) trans 8589950638 rc 0/0 00000100:00100000:3.0:1777580311.278241:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4155 00000100:00100000:1.0:1777580311.278482:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.279022:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946614272 00000100:00100000:3.0:1777580311.279034:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946614272 00000100:00100000:3.0:1777580311.279092:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11816 00000100:00100000:3.0:1777580311.279103:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946614272:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.279555:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2361:x1863919946614272:12345-192.168.202.9@tcp:2:touch.500 Request processed in 453us (1073us total) trans 8589938563 rc 0/0 00000100:00100000:3.0:1777580311.279563:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11816 00000100:00100000:0.0:1777580311.286059:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.286109:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.286179:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946614656 00000100:00100000:0.0:1777580311.286191:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946614656 00000100:00100000:0.0:1777580311.286256:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11817 00000100:00100000:0.0:1777580311.286268:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2361:x1863919946614656:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.286293:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.286322:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e33b expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.286358:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a1:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.286386:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.286388:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.286399:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 33 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.286421:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 33 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.286438:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249dea3800, rc 0) 00000100:00100000:0.0:1777580311.286504:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2361:x1863919946614656:12345-192.168.202.9@tcp:101:rm.500 Request processed in 239us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.286512:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11817 00000100:00100000:3.0:1777580311.286984:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946614528 00000100:00100000:3.0:1777580311.286998:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946614528 00000100:00100000:3.0:1777580311.287029:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832167007835 time 7832215507786 state 0x0 ref 1 00000100:00100000:3.0:1777580311.287042:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832215607786 time 7832215507786 state 0x1 ref 1 00000100:00100000:3.0:1777580311.287076:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832215607786 time 7832235938066 state 0x0 ref 1 00000100:00100000:3.0:1777580311.287087:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:283014:x1863919946614528:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.287109:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.287127:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a47d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e334 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287329:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287346:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287359:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287373:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287379:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.287385:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580311.288065:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ca:0x0], index 0: 0 00010000:00010000:3.0:1777580311.288325:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a492 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288339:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288350:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288396:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288404:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288413:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288419:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.288424:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288432:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288445:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580311.288448:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.288453:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288460:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a484 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.288490:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003dec7956 reply state 00000000f0f83764 transno 8589950639 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.288499:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580311.288539:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a47d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e334 expref: 191 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288555:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e334 expref: 190 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.288563:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580311.288565:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580311.288567:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031c00, rc 0) 00000100:00100000:3.0:1777580311.288654:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283014:x1863919946614528:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1569us (2544us total) trans 8589950639 rc 0/0 00000100:00100000:3.0:1777580311.288664:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19381 00000100:00100000:3.0:1777580311.288672:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832215607786 time 7832235938066 state 0x2 ref 0 00000100:00100000:3.0:1777580311.293057:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.302557:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946614912 00000100:00100000:1.0:1777580311.302580:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946614912 00000100:00100000:1.0:1777580311.302666:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4156 00000100:00100000:1.0:1777580311.302679:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:282998:x1863919946614912:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.303664:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:282998:x1863919946614912:12345-192.168.202.9@tcp:35:touch.500 Request processed in 979us (10610us total) trans 8589950640 rc 0/0 00000100:00100000:1.0:1777580311.303676:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4156 00000100:00100000:0.0:1777580311.322198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.323590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580311.323731:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.323746:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.323754:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.323779:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.323786:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.323795:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.325255:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615168 00000100:00100000:0.0:1777580311.325274:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615168 00010000:00010000:3.0:1777580311.325970:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580311.325979:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.325989:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.326001:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4a48b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.326067:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615296 00000100:00100000:3.0:1777580311.326074:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615296 00000100:00100000:3.0:1777580311.326124:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832171138667 time 7832176725512 state 0x0 ref 1 00000100:00100000:3.0:1777580311.326155:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832176825512 time 7832176725512 state 0x1 ref 1 00000100:00100000:3.0:1777580311.326187:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832176825512 time 7832275048782 state 0x0 ref 1 00000100:00100000:3.0:1777580311.326206:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283025:x1863919946615296:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580311.326235:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.326257:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4a4a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e342 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.326390:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832215607786 time 7832235938066 state 0x0 ref 1 00000100:00100000:0.0:1777580311.326399:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832236038066 time 7832235938066 state 0x1 ref 1 00000100:00100000:0.0:1777580311.326434:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832236038066 time 7832275296840 state 0x0 ref 1 00000100:00100000:0.0:1777580311.326445:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283014:x1863919946615168:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.326500:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.326525:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4a492 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e334 expref: 193 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.326543:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:0.0:1777580311.326550:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.326634:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.326648:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.326659:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328034:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328068:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328080:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328100:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328108:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328114:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328273:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328282:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.328940:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580311.328987:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80b:0x0]: returning size 0 00000004:00200000:3.0:1777580311.328993:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580311.329020:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329036:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329062:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329069:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329077:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329083:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.329088:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329097:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329112:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580311.329116:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.329121:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329127:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4a4ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329158:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329164:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329169:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329181:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.329184:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329191:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329200:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02499549300) 00010000:00010000:3.0:1777580311.329203:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.329206:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329213:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a4b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329261:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4a4a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e342 expref: 194 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.329278:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e342 expref: 193 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.329432:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000c0543ef reply state 00000000a028aefb transno 8589950641 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.329445:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.329575:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283014:x1863919946615168:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3131us (7389us total) trans 8589950641 rc 0/0 00000100:00100000:0.0:1777580311.329592:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19383 00000100:00100000:0.0:1777580311.329603:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832236038066 time 7832275296840 state 0x2 ref 0 00010000:00010000:3.0:1777580311.333530:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02486090900) 00010000:00010000:3.0:1777580311.333539:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580311.333543:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:3.0:1777580311.333670:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283025:x1863919946615296:12345-192.168.202.9@tcp:101:rm.500 Request processed in 7464us (10082us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.333681:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19382 00000100:00100000:3.0:1777580311.333691:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832176825512 time 7832275048782 state 0x2 ref 0 00000100:00100000:0.0:1777580311.338347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.338385:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338400:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338408:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338414:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.338421:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338429:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338450:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:0.0:1777580311.338454:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.338459:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338465:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4a4a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.338515:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615424 00000100:00100000:0.0:1777580311.338528:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615424 00000100:00100000:0.0:1777580311.338573:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832236038066 time 7832275296840 state 0x0 ref 1 00000100:00100000:0.0:1777580311.338602:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275396840 time 7832275296840 state 0x1 ref 1 00000100:00100000:0.0:1777580311.338634:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275396840 time 7832287495968 state 0x0 ref 1 00000100:00100000:0.0:1777580311.338648:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283014:x1863919946615424:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.338681:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.338702:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4a4c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e349 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338772:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e349 expref: 193 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338789:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e349 expref: 193 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.338815:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa02491fc3500) 00010000:00010000:0.0:1777580311.338819:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580311.338822:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff0400, rc 0) 00000100:00100000:0.0:1777580311.338900:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283014:x1863919946615424:12345-192.168.202.9@tcp:101:touch.500 Request processed in 255us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.338909:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19384 00000100:00100000:0.0:1777580311.338915:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275396840 time 7832287495968 state 0x2 ref 0 00000100:00100000:3.0:1777580311.347264:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.347315:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615680 00000100:00100000:3.0:1777580311.347327:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615680 00000100:00100000:3.0:1777580311.347378:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275396840 time 7832287495968 state 0x0 ref 1 00000100:00100000:3.0:1777580311.347395:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832287595968 time 7832287495968 state 0x1 ref 1 00000100:00100000:3.0:1777580311.347427:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832287595968 time 7832296288691 state 0x0 ref 1 00000100:00100000:3.0:1777580311.347441:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283013:x1863919946615680:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.347468:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.347492:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a4ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e350 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347677:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347697:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347711:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347729:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347736:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.347743:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580311.348410:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a6:0x0], index 1: 0 00010000:00010000:3.0:1777580311.348632:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a4df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348643:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a4df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348652:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a4df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348690:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348697:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348705:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348711:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.348716:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348723:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348736:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580311.348739:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.348745:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348762:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a4d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.348777:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c62ddfab reply state 000000001d425cb5 transno 8589950642 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.348786:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580311.348825:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a4ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e350 expref: 196 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348856:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a4df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e350 expref: 195 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.348864:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02499549a00) 00010000:00010000:3.0:1777580311.348866:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580311.348869:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fa00, rc 0) 00000100:00100000:3.0:1777580311.348963:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283013:x1863919946615680:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1523us (1713us total) trans 8589950642 rc 0/0 00000100:00100000:3.0:1777580311.348975:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19385 00000100:00100000:3.0:1777580311.348984:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832287595968 time 7832296288691 state 0x2 ref 0 00000100:00100000:3.0:1777580311.356267:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.356396:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580311.356433:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356447:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356471:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356478:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.356483:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356493:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356513:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02499549700) 00010000:00010000:3.0:1777580311.356516:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.356522:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.356528:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a4d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.356644:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615808 00000100:00100000:0.0:1777580311.356657:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615808 00000100:00100000:0.0:1777580311.356717:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946615936 00000100:00100000:0.0:1777580311.356721:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946615936 00000100:00100000:0.0:1777580311.356756:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11818 00000100:00100000:0.0:1777580311.356768:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946615808:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.357226:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946615808:12345-192.168.202.9@tcp:2:touch.500 Request processed in 458us (972us total) trans 8589938964 rc 0/0 00000100:00100000:0.0:1777580311.357235:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11818 00000100:00100000:0.0:1777580311.357258:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11819 00000100:00100000:0.0:1777580311.357266:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946615936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.357278:0:206020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.357302:0:206020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e357 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.357334:0:206020:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a4:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.357353:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.357356:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.357366:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 34 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.357387:0:206020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 34 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.357404:0:206020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1400, rc 0) 00000100:00100000:0.0:1777580311.357426:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946615936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 162us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.357432:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11819 00000100:00100000:3.0:1777580311.368313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.368365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.368488:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946616192 00000100:00100000:1.0:1777580311.368501:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946616192 00000100:00100000:1.0:1777580311.368553:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832287595968 time 7832296288691 state 0x0 ref 1 00000100:00100000:1.0:1777580311.368569:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832296388691 time 7832296288691 state 0x1 ref 1 00000100:00100000:1.0:1777580311.368598:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946616448 00000100:00100000:1.0:1777580311.368601:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946616448 00000100:00100000:1.0:1777580311.368613:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832296388691 time 7832296288691 state 0x1 ref 2 00000100:00100000:1.0:1777580311.368635:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832317597923 time 7832317497923 state 0x1 ref 2 00000100:00100000:1.0:1777580311.368666:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283013:x1863919946616192:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:2.0:1777580311.368668:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832317597923 time 7832317529398 state 0x0 ref 2 00000100:00100000:2.0:1777580311.368679:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283015:x1863919946616448:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.368697:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.368722:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a4f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e35e expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.368737:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.368763:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a4df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e350 expref: 197 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.368782:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02499549a00) 00010000:00010000:1.0:1777580311.368793:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.368885:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.368885:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.368901:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.368901:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.368913:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.368913:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.368929:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.368935:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.368948:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580311.369070:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000050cb6b74 reply state 000000006ecd70a7 transno 8589950643 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.369080:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580311.369227:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+198:283013:x1863919946616192:12345-192.168.202.9@tcp:36:touch.500 Request processed in 564us (940us total) trans 8589950643 rc 0/0 00000100:00100000:1.0:1777580311.369236:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19386 00000004:00080000:2.0:1777580311.369766:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15cb:0x0], index 0: 0 00010000:00010000:2.0:1777580311.369962:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a510 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.369975:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a510 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.369985:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a510 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.370948:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.370989:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946616704 00000100:00100000:3.0:1777580311.371000:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946616704 00000100:00100000:3.0:1777580311.371058:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4157 00000100:00100000:3.0:1777580311.371068:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+199:283014:x1863919946616704:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:2.0:1777580311.371181:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371192:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371200:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371206:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.371210:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371218:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371232:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.371235:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.371259:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371265:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a4fb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.371282:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006466c531 reply state 0000000014b26d46 transno 8589950644 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.371292:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.371337:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a4f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e35e expref: 201 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371352:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a510 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e35e expref: 200 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.371359:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580311.371361:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.371364:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9bc00, rc 0) 00000100:00100000:3.0:1777580311.376120:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+201:283014:x1863919946616704:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5034us (5160us total) trans 8589950645 rc 0/0 00000100:00100000:3.0:1777580311.376155:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4157 00000100:00100000:2.0:1777580311.378384:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+200:283015:x1863919946616448:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8555us (8867us total) trans 8589950644 rc 0/0 00000100:00100000:2.0:1777580311.378409:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19387 00000100:00100000:2.0:1777580311.378668:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832317597923 time 7832317529398 state 0x2 ref 0 00000100:00100000:3.0:1777580311.385702:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.388598:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946616832 00000100:00100000:3.0:1777580311.388618:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946616832 00000100:00100000:3.0:1777580311.388675:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832317597923 time 7832317529398 state 0x0 ref 1 00000100:00100000:3.0:1777580311.388693:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832317629398 time 7832317529398 state 0x1 ref 1 00000100:00100000:3.0:1777580311.388724:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832317629398 time 7832337585366 state 0x0 ref 1 00000100:00100000:3.0:1777580311.388742:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+200:283013:x1863919946616832:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.388779:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.388808:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a51e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e365 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.388901:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a51e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e365 expref: 201 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.388919:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a51e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e365 expref: 201 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.388941:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:3.0:1777580311.388944:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.388950:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51800, rc 0) 00000100:00100000:3.0:1777580311.389030:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+201:283013:x1863919946616832:12345-192.168.202.9@tcp:101:touch.500 Request processed in 295us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.389038:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19388 00000100:00100000:3.0:1777580311.389044:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832317629398 time 7832337585366 state 0x2 ref 0 00010000:00010000:3.0:1777580311.392525:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392548:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392558:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392565:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.392573:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392582:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392606:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:3.0:1777580311.392610:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.392616:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.392624:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4a502 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.396067:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.396114:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.396234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.396275:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946617344 00000100:00100000:0.0:1777580311.396288:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946617344 00000100:00100000:0.0:1777580311.396335:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832317629398 time 7832337585366 state 0x0 ref 1 00000100:00100000:0.0:1777580311.396350:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832337685366 time 7832337585366 state 0x1 ref 1 00000100:00100000:0.0:1777580311.396371:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946617216 00000100:00100000:0.0:1777580311.396374:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946617216 00000100:00100000:0.0:1777580311.396383:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832337685366 time 7832337585366 state 0x1 ref 2 00000100:00100000:0.0:1777580311.396401:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832345363352 time 7832345263352 state 0x1 ref 2 00000100:00100000:0.0:1777580311.396412:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+201:283015:x1863919946617344:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.396497:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.396531:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a510 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e35e expref: 201 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.396556:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02488b77800) 00010000:00010000:0.0:1777580311.396568:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.396667:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.396683:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.396696:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.396891:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005e727eb0 reply state 00000000711c127e transno 8589950646 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.396910:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.397018:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+202:283015:x1863919946617344:12345-192.168.202.9@tcp:36:touch.500 Request processed in 605us (965us total) trans 8589950646 rc 0/0 00000100:00100000:0.0:1777580311.397026:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19389 00000100:00100000:0.0:1777580311.397053:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832345363352 time 7832345915324 state 0x0 ref 1 00000100:00100000:0.0:1777580311.397064:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+201:283000:x1863919946617216:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.397077:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.397092:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4a52c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e36c expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397246:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397258:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397267:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397288:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397296:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.397304:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580311.397813:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a7:0x0], index 1: 0 00010000:00010000:0.0:1777580311.398008:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4a541 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398019:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4a541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398027:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4a541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398065:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398072:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398078:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398084:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.398089:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398097:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398109:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.398111:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.398116:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398165:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4a533 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.398184:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008643bfa4 reply state 0000000035384adb transno 8589950647 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.398193:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580311.398227:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4a52c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e36c expref: 204 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398243:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4a541 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e36c expref: 203 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.398252:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:0.0:1777580311.398254:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580311.398257:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8400, rc 0) 00000100:00100000:0.0:1777580311.398319:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+204:283000:x1863919946617216:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1256us (2203us total) trans 8589950647 rc 0/0 00000100:00100000:0.0:1777580311.398328:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19390 00000100:00100000:0.0:1777580311.398334:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832345363352 time 7832345915324 state 0x2 ref 0 00000100:00100000:0.0:1777580311.410282:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946617472 00000100:00100000:0.0:1777580311.410312:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946617472 00000100:00100000:0.0:1777580311.410396:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11820 00000100:00100000:0.0:1777580311.410409:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946617472:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.410880:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946617472:12345-192.168.202.9@tcp:2:touch.500 Request processed in 473us (14643us total) trans 8589938564 rc 0/0 00000100:00100000:0.0:1777580311.410901:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11820 00010000:00010000:3.0:1777580311.418259:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418281:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418300:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418324:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.418329:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418338:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418359:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02488b77200) 00010000:00010000:3.0:1777580311.418362:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.418367:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.418374:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4a509 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.419329:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.419361:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.419427:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.419451:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419460:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419467:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419473:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.419477:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419484:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419495:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0249f66ff00) 00010000:00010000:0.0:1777580311.419498:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.419502:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.419509:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4a53a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.419552:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946617728 00000100:00100000:0.0:1777580311.419565:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946617728 00010000:00010000:3.0:1777580311.421184:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421201:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421209:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421215:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.421220:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421226:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421263:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580311.421266:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.421271:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421277:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a525 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.421600:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946617984 00000100:00100000:2.0:1777580311.421612:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946617984 00000100:00100000:2.0:1777580311.421657:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832345363352 time 7832345915324 state 0x0 ref 1 00000100:00100000:2.0:1777580311.421670:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832346015324 time 7832345915324 state 0x1 ref 1 00000100:00100000:2.0:1777580311.421692:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946618112 00000100:00100000:2.0:1777580311.421702:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946618112 00000100:00100000:2.0:1777580311.421717:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832346015324 time 7832345915324 state 0x1 ref 2 00000100:00100000:2.0:1777580311.421743:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832370705380 time 7832370605380 state 0x1 ref 2 00000100:00100000:2.0:1777580311.421760:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+202:283005:x1863919946617984:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.421791:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.421814:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a54f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e373 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.421832:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832370705380 time 7832370693017 state 0x0 ref 2 00000100:00100000:3.0:1777580311.421853:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+203:283015:x1863919946618112:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.421864:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.421877:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a556 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e37a expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421928:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x810:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e37a expref: 204 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421941:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x810:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e37a expref: 204 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.421958:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02499549700) 00010000:00010000:3.0:1777580311.421961:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.421963:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f200, rc 0) 00010000:00010000:2.0:1777580311.421988:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.421999:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.422008:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.422021:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.422026:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.422032:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.422037:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+204:283015:x1863919946618112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 186us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.422045:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19392 00000100:00100000:0.0:1777580311.424484:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832370793017 time 7832370693017 state 0x1 ref 2 00000100:00100000:0.0:1777580311.424537:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832370793017 time 7832373398908 state 0x0 ref 2 00000100:00100000:0.0:1777580311.424556:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+204:283000:x1863919946617728:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.424624:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.424656:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4a541 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e36c expref: 204 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.424683:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:0.0:1777580311.424697:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.424785:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.424800:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.424991:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.425189:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e3cff14 reply state 000000007484602d transno 8589950648 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.425201:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.425382:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+205:283000:x1863919946617728:12345-192.168.202.9@tcp:36:touch.500 Request processed in 831us (6060us total) trans 8589950648 rc 0/0 00000100:00100000:0.0:1777580311.425391:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19393 00000100:00100000:0.0:1777580311.426019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:2.0:1777580311.429557:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15cc:0x0], index 0: 0 00010000:00010000:2.0:1777580311.429823:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429874:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429888:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429941:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429949:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429957:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429963:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.429968:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429978:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.429994:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.429998:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.430002:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.430529:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a55d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.430550:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009ba4ab21 reply state 00000000c738a993 transno 8589950649 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.430569:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.430626:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a54f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e373 expref: 206 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.430644:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e373 expref: 205 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.430652:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580311.430654:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.430657:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:2.0:1777580311.430748:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+206:283005:x1863919946617984:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8993us (11385us total) trans 8589950649 rc 0/0 00000100:00100000:2.0:1777580311.430760:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19391 00000100:00100000:2.0:1777580311.430769:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832370793017 time 7832373398908 state 0x2 ref 0 00000100:00100000:0.0:1777580311.433511:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946618368 00000100:00100000:0.0:1777580311.433530:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946618368 00000100:00100000:0.0:1777580311.433636:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4158 00000100:00100000:0.0:1777580311.433649:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+206:283013:x1863919946618368:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580311.434171:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+207:283013:x1863919946618368:12345-192.168.202.9@tcp:35:touch.500 Request processed in 522us (8152us total) trans 8589950650 rc 0/0 00000100:00100000:0.0:1777580311.434181:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4158 00000100:00100000:0.0:1777580311.438489:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.438568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.438605:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438620:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438629:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438636:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.438641:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438650:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438672:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02488b77a00) 00010000:00010000:0.0:1777580311.438675:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.438681:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.438688:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a564 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439096:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439105:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439113:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439118:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.439122:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439127:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439167:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa0249f66f700) 00010000:00010000:3.0:1777580311.439170:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.439173:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.439178:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a56b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.439319:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946618496 00000100:00100000:1.0:1777580311.439332:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946618496 00000100:00100000:1.0:1777580311.439379:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832370793017 time 7832373398908 state 0x0 ref 1 00000100:00100000:1.0:1777580311.439393:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832373498908 time 7832373398908 state 0x1 ref 1 00000100:00100000:1.0:1777580311.439438:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946618880 00000100:00100000:1.0:1777580311.439442:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946618880 00000100:00100000:1.0:1777580311.439458:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832373498908 time 7832373398908 state 0x1 ref 2 00000100:00100000:1.0:1777580311.439480:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388442515 time 7832388342515 state 0x1 ref 2 00000100:00100000:1.0:1777580311.439494:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+206:283000:x1863919946618496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580311.439525:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.439550:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a580 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e381 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.439626:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a580 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x811:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e381 expref: 207 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.439642:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a580 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x811:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e381 expref: 207 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.439662:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:1.0:1777580311.439665:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580311.439668:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838e00, rc 0) 00000100:00100000:1.0:1777580311.439746:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+207:283000:x1863919946618496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 255us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.439755:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19394 00000100:00100000:1.0:1777580311.439779:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388442515 time 7832388642663 state 0x0 ref 1 00000100:00100000:1.0:1777580311.439789:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+206:283019:x1863919946618880:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580311.439822:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.439834:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a587 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e388 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.439996:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440008:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440017:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440031:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440038:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440044:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580311.440610:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a8:0x0], index 1: 0 00010000:00010000:1.0:1777580311.440816:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a59c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440827:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440835:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440900:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440908:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440914:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440919:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.440924:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440930:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440941:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.440944:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.440948:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.440953:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a58e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580311.440966:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005cf9fb01 reply state 000000006e7f41b4 transno 8589950651 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.440977:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580311.441013:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a587 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e388 expref: 209 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.441039:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a59c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e388 expref: 208 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.441046:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:1.0:1777580311.441049:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.441052:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838600, rc 0) 00000100:00100000:1.0:1777580311.441110:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+209:283019:x1863919946618880:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1321us (2541us total) trans 8589950651 rc 0/0 00000100:00100000:1.0:1777580311.441119:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19395 00000100:00100000:1.0:1777580311.441125:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388442515 time 7832388642663 state 0x2 ref 0 00000100:00100000:0.0:1777580311.446210:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.446255:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.446376:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619008 00000100:00100000:3.0:1777580311.446390:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619008 00000100:00100000:3.0:1777580311.446455:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388442515 time 7832388642663 state 0x0 ref 1 00000100:00100000:3.0:1777580311.446473:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388742663 time 7832388642663 state 0x1 ref 1 00000100:00100000:3.0:1777580311.446511:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388742663 time 7832395372747 state 0x0 ref 1 00000100:00100000:3.0:1777580311.446523:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+209:283005:x1863919946619008:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580311.446606:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.446642:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a572 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e373 expref: 209 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.446663:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02488b77500) 00010000:00010000:3.0:1777580311.446675:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580311.446766:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.446782:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.446794:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.447239:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000055d85e91 reply state 00000000afbcc45f transno 8589950652 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.447251:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580311.447374:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+210:283005:x1863919946619008:12345-192.168.202.9@tcp:36:touch.500 Request processed in 851us (1176us total) trans 8589950652 rc 0/0 00000100:00100000:3.0:1777580311.447384:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19396 00000100:00100000:3.0:1777580311.447390:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388742663 time 7832395372747 state 0x2 ref 0 00000100:00100000:3.0:1777580311.448064:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619136 00000100:00100000:3.0:1777580311.448075:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619136 00000100:00100000:3.0:1777580311.448207:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11821 00000100:00100000:3.0:1777580311.448217:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2361:x1863919946619136:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.452443:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2361:x1863919946619136:12345-192.168.202.9@tcp:2:touch.500 Request processed in 4206us (6165us total) trans 8589938965 rc 0/0 00000100:00100000:3.0:1777580311.452484:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11821 00000100:00100000:0.0:1777580311.463783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.463831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.463869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.463906:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580311.465097:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465115:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465124:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465130:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.465166:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465196:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465220:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02486090400) 00010000:00010000:3.0:1777580311.465223:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.465229:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.465235:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a595 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.478776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.478922:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619392 00000100:00100000:2.0:1777580311.478937:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619392 00000100:00100000:2.0:1777580311.478995:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832388742663 time 7832395372747 state 0x0 ref 1 00000100:00100000:2.0:1777580311.479026:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832395472747 time 7832395372747 state 0x1 ref 1 00000100:00100000:2.0:1777580311.479059:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619648 00000100:00100000:2.0:1777580311.479064:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619648 00000100:00100000:2.0:1777580311.479079:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832395472747 time 7832395372747 state 0x1 ref 2 00000100:00100000:2.0:1777580311.479093:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619904 00000100:00100000:2.0:1777580311.479096:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619904 00000100:00100000:2.0:1777580311.479108:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832395472747 time 7832395372747 state 0x1 ref 3 00000100:00100000:2.0:1777580311.479162:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832428123367 time 7832428023367 state 0x1 ref 3 00000100:00100000:2.0:1777580311.479177:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+211:283019:x1863919946619392:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580311.482060:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.482117:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a59c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e388 expref: 211 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.482165:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02484c59c00) 00010000:00010000:2.0:1777580311.482180:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.482290:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.482306:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.482317:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.482684:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a76d75ff reply state 00000000ead9a614 transno 8589950653 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.482697:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580311.482861:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+212:283019:x1863919946619392:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3685us (19090us total) trans 8589950653 rc 0/0 00000100:00100000:2.0:1777580311.482871:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19397 00000100:00100000:2.0:1777580311.482924:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832431883061 time 7832431783061 state 0x1 ref 2 00000100:00100000:2.0:1777580311.482943:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+211:283018:x1863919946619648:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.482981:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.482997:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a5b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e38f expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.483162:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832431883061 time 7832432022189 state 0x0 ref 2 00000100:00100000:1.0:1777580311.483178:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+211:283005:x1863919946619904:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580311.483190:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.483202:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a5bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e396 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.483251:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a5bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x812:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e396 expref: 212 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.483265:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a5bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x812:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e396 expref: 212 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.483285:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02499549300) 00010000:00010000:1.0:1777580311.483295:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580311.483299:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838400, rc 0) 00000100:00100000:1.0:1777580311.483329:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+212:283005:x1863919946619904:12345-192.168.202.9@tcp:101:touch.500 Request processed in 154us (19421us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.483336:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19399 00000100:00100000:1.0:1777580311.483373:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946620160 00000100:00100000:1.0:1777580311.483383:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946620160 00000100:00100000:1.0:1777580311.483428:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4159 00000100:00100000:1.0:1777580311.483447:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+212:283015:x1863919946620160:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.483727:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+213:283015:x1863919946620160:12345-192.168.202.9@tcp:35:touch.500 Request processed in 279us (4966us total) trans 8589950654 rc 0/0 00000100:00100000:1.0:1777580311.483736:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4159 00010000:00010000:2.0:1777580311.487274:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.487299:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.487315:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.487334:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.487341:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.487348:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.488635:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15cd:0x0], index 0: 0 00010000:00010000:2.0:1777580311.488874:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a5d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488891:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488901:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488966:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488975:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488981:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.488988:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.488993:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.489002:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.489029:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.489032:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.489037:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.489044:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a5c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.489059:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b1578e74 reply state 00000000fe76a258 transno 8589950655 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.489069:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.489113:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a5b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e38f expref: 215 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.489166:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e38f expref: 214 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.489174:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580311.489176:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.489179:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b200, rc 0) 00000100:00100000:2.0:1777580311.489261:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+215:283018:x1863919946619648:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6324us (25429us total) trans 8589950655 rc 0/0 00000100:00100000:2.0:1777580311.489273:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19398 00000100:00100000:2.0:1777580311.489297:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832431883061 time 7832432022189 state 0x2 ref 0 00000100:00100000:0.0:1777580311.493756:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946619776 00000100:00100000:0.0:1777580311.493776:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946619776 00000100:00100000:0.0:1777580311.493866:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11822 00000100:00100000:0.0:1777580311.493880:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2363:x1863919946619776:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.494373:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946619776:12345-192.168.202.9@tcp:2:touch.500 Request processed in 494us (30500us total) trans 8589938565 rc 0/0 00000100:00100000:0.0:1777580311.494383:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11822 00010000:00010000:0.0:1777580311.494549:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494562:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494571:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494577:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.494583:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494590:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494625:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02499549300) 00010000:00010000:0.0:1777580311.494628:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.494633:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.494639:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4a5aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504912:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504935:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504956:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504963:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.504969:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504977:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.504997:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02488b77a00) 00010000:00010000:3.0:1777580311.505000:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.505006:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.505014:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a5b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.506050:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.506169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.506256:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946620416 00000100:00100000:0.0:1777580311.506270:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946620416 00000100:00100000:0.0:1777580311.506318:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832431883061 time 7832432022189 state 0x0 ref 1 00000100:00100000:0.0:1777580311.506334:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832432122189 time 7832432022189 state 0x1 ref 1 00000100:00100000:0.0:1777580311.506362:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832432122189 time 7832455224336 state 0x0 ref 1 00000100:00100000:0.0:1777580311.506376:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+213:283018:x1863919946620416:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.506447:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.506475:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a5d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e38f expref: 213 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.506495:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa02488b77800) 00010000:00010000:0.0:1777580311.506506:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.506595:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.506609:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.506636:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.506803:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c5f6168b reply state 00000000616ca4ef transno 8589950656 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.506813:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.506949:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+214:283018:x1863919946620416:12345-192.168.202.9@tcp:36:touch.500 Request processed in 574us (908us total) trans 8589950656 rc 0/0 00000100:00100000:0.0:1777580311.506957:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19400 00000100:00100000:0.0:1777580311.506963:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832432122189 time 7832455224336 state 0x2 ref 0 00010000:00010000:0.0:1777580311.507008:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507017:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507024:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507030:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.507035:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507042:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507053:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02488b77200) 00010000:00010000:0.0:1777580311.507056:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.507067:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.507074:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a5cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.511451:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946620672 00000100:00100000:1.0:1777580311.511472:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946620672 00000100:00100000:1.0:1777580311.511592:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4160 00000100:00100000:1.0:1777580311.511604:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+213:283000:x1863919946620672:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.512072:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+214:283000:x1863919946620672:12345-192.168.202.9@tcp:35:touch.500 Request processed in 470us (5901us total) trans 8589950657 rc 0/0 00000100:00100000:1.0:1777580311.512081:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4160 00000100:00100000:3.0:1777580311.519988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.520175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.520208:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.520275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580311.520311:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520325:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520349:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520356:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.520362:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520372:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520390:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:3.0:1777580311.520394:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.520399:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520406:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a5e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.520645:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946620800 00000100:00100000:2.0:1777580311.520656:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946620800 00000100:00100000:2.0:1777580311.520703:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832432122189 time 7832455224336 state 0x0 ref 1 00000100:00100000:2.0:1777580311.520717:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832455324336 time 7832455224336 state 0x1 ref 1 00000100:00100000:2.0:1777580311.520741:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621056 00000100:00100000:2.0:1777580311.520745:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621056 00000100:00100000:2.0:1777580311.520757:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832455324336 time 7832455224336 state 0x1 ref 2 00000100:00100000:2.0:1777580311.520771:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621312 00000100:00100000:2.0:1777580311.520773:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621312 00000100:00100000:3.0:1777580311.520780:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832469741571 time 7832469641571 state 0x1 ref 2 00000100:00100000:2.0:1777580311.520792:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832469741571 time 7832469641571 state 0x1 ref 3 00000100:00100000:3.0:1777580311.520796:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+215:283019:x1863919946620800:12345-192.168.202.9@tcp:101:touch.500 00000100:00100000:2.0:1777580311.520813:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7832469776841 time 7832469676841 state 0x1 ref 3 00000100:00100000:2.0:1777580311.520822:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+215:283017:x1863919946621056:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.520848:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.520848:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.520867:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a5f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e39d expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.520867:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a5e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3a4 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520933:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x813:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e39d expref: 217 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520948:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x813:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e39d expref: 217 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.520973:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02499549a00) 00010000:00010000:3.0:1777580311.520975:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.520978:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6ec00, rc 0) 00000100:00100000:3.0:1777580311.521045:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+217:283019:x1863919946620800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 252us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.521053:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19401 00000100:00100000:3.0:1777580311.521076:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832469776841 time 7832469939122 state 0x0 ref 2 00000100:00100000:3.0:1777580311.521086:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+216:283018:x1863919946621312:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.521096:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.521109:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a5f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3ab expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.521158:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x814:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ab expref: 217 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.521169:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x814:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ab expref: 217 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.521182:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580311.521184:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.521187:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1c00, rc 0) 00000100:00100000:3.0:1777580311.521208:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+217:283018:x1863919946621312:12345-192.168.202.9@tcp:101:touch.500 Request processed in 123us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.521214:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19403 00000100:00100000:0.0:1777580311.522047:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621184 00000100:00100000:0.0:1777580311.522059:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621184 00000100:00100000:0.0:1777580311.522129:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11823 00000100:00100000:0.0:1777580311.522159:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946621184:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.522548:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946621184:12345-192.168.202.9@tcp:2:touch.500 Request processed in 391us (2338us total) trans 8589938966 rc 0/0 00000100:00100000:0.0:1777580311.522556:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11823 00010000:00010000:2.0:1777580311.523549:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.523574:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.523587:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.523606:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.523613:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.523620:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.528741:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a9:0x0], index 1: 0 00010000:00010000:2.0:1777580311.533062:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a60c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533091:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533106:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533216:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533226:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533233:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533239:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.533244:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533252:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533264:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.533267:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.533271:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533277:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a5fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.533295:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f2a2ad9f reply state 0000000097c2893a transno 8589950658 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.533305:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.533365:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a5e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3a4 expref: 218 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533394:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a60c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3a4 expref: 217 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.533402:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa024acb3ec00) 00010000:00010000:2.0:1777580311.533405:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.533407:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:2.0:1777580311.533512:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+218:283017:x1863919946621056:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12688us (13334us total) trans 8589950658 rc 0/0 00000100:00100000:2.0:1777580311.533523:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19402 00000100:00100000:2.0:1777580311.533532:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832469776841 time 7832469939122 state 0x2 ref 0 00010000:00010000:3.0:1777580311.542308:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542333:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542343:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542350:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.542356:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542366:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542388:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02488b77500) 00010000:00010000:3.0:1777580311.542391:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.542397:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.542404:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a605 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.548804:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.548861:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.548884:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.548909:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.553655:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621440 00000100:00100000:3.0:1777580311.553674:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621440 00000100:00100000:3.0:1777580311.553745:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621568 00000100:00100000:3.0:1777580311.553748:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621568 00000100:00100000:0.0:1777580311.553960:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.553986:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946621824 00000100:00100000:0.0:1777580311.553990:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946621824 00000100:00100000:0.0:1777580311.554022:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832469776841 time 7832469939122 state 0x0 ref 1 00000100:00100000:0.0:1777580311.554038:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832470039122 time 7832469939122 state 0x1 ref 1 00000100:00100000:0.0:1777580311.554057:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946622336 00000100:00100000:0.0:1777580311.554059:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946622336 00000100:00100000:0.0:1777580311.554072:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832470039122 time 7832469939122 state 0x1 ref 2 00000100:00100000:0.0:1777580311.554091:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503053557 time 7832502953557 state 0x1 ref 2 00000100:00100000:0.0:1777580311.554115:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+218:283017:x1863919946621824:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.554205:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.554240:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a60c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3a4 expref: 218 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554276:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa024acb3ec00) 00010000:00010000:0.0:1777580311.554289:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.554384:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554402:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554414:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.554604:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e20836e9 reply state 00000000c714f335 transno 8589950659 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.554614:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.554727:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+219:283017:x1863919946621824:12345-192.168.202.9@tcp:36:touch.500 Request processed in 613us (5938us total) trans 8589950659 rc 0/0 00000100:00100000:0.0:1777580311.554736:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19404 00000100:00100000:0.0:1777580311.554765:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503053557 time 7832503628188 state 0x0 ref 1 00000100:00100000:0.0:1777580311.554777:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+218:283021:x1863919946622336:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.554789:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.554809:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a621 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3b2 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554941:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554953:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554962:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554978:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554984:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.554990:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580311.555565:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ce:0x0], index 0: 0 00010000:00010000:0.0:1777580311.555751:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a636 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555762:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555772:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555811:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555829:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555851:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555859:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.555865:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555874:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555888:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.555890:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.555896:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555902:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a628 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.555920:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7053adc reply state 00000000415a27f1 transno 8589950660 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.555929:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580311.555967:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a621 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b2 expref: 221 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.555984:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b2 expref: 220 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.556003:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa0249f66fe00) 00010000:00010000:0.0:1777580311.556006:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580311.556008:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f400, rc 0) 00000100:00100000:0.0:1777580311.556072:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+221:283021:x1863919946622336:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1296us (2117us total) trans 8589950660 rc 0/0 00000100:00100000:0.0:1777580311.556082:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19405 00000100:00100000:0.0:1777580311.556090:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503053557 time 7832503628188 state 0x2 ref 0 00000100:00100000:1.0:1777580311.560711:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946622080 00000100:00100000:1.0:1777580311.560732:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946622080 00000100:00100000:1.0:1777580311.560848:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4161 00000100:00100000:1.0:1777580311.560862:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+221:283005:x1863919946622080:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.561347:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+222:283005:x1863919946622080:12345-192.168.202.9@tcp:35:touch.500 Request processed in 487us (12435us total) trans 8589950661 rc 0/0 00000100:00100000:1.0:1777580311.561367:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4161 00000100:00100000:3.0:1777580311.573614:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11824 00000100:00100000:3.0:1777580311.573644:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946621440:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.574183:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2361:x1863919946621440:12345-192.168.202.9@tcp:2:touch.500 Request processed in 555us (25319us total) trans 8589938566 rc 0/0 00000100:00100000:3.0:1777580311.574206:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11824 00000100:00100000:3.0:1777580311.574230:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11825 00000100:00100000:3.0:1777580311.574238:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2361:x1863919946621568:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580311.574412:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946621568:12345-192.168.202.9@tcp:2:touch.500 Request processed in 175us (25526us total) trans 8589938967 rc 0/0 00000100:00100000:3.0:1777580311.574418:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11825 00010000:00010000:3.0:1777580311.589346:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589372:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589383:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589390:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.589396:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589404:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589423:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa0249f66ff00) 00010000:00010000:3.0:1777580311.589426:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.589431:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.589439:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4a61a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.616888:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.616915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.616933:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.617163:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946622592 00000100:00100000:2.0:1777580311.617178:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946622592 00000100:00100000:2.0:1777580311.617227:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503053557 time 7832503628188 state 0x0 ref 1 00000100:00100000:2.0:1777580311.617244:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503728188 time 7832503628188 state 0x1 ref 1 00000100:00100000:2.0:1777580311.617265:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946622976 00000100:00100000:2.0:1777580311.617268:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946622976 00000100:00100000:2.0:1777580311.617280:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503728188 time 7832503628188 state 0x1 ref 2 00000100:00100000:1.0:1777580311.617681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.617710:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946623232 00000100:00100000:1.0:1777580311.617715:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946623232 00000100:00100000:1.0:1777580311.617750:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4162 00000100:00100000:1.0:1777580311.617760:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+223:283018:x1863919946623232:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580311.618553:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946622720 00000100:00100000:2.0:1777580311.618560:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946622720 00000100:00100000:2.0:1777580311.618585:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832503728188 time 7832503628188 state 0x1 ref 3 00000100:00100000:2.0:1777580311.618609:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832567571354 time 7832567471354 state 0x1 ref 3 00000100:00100000:2.0:1777580311.618621:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+224:283021:x1863919946622592:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580311.618680:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.618713:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4a636 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b2 expref: 224 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.618740:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa0249f66fe00) 00010000:00010000:2.0:1777580311.618753:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.618854:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.618871:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.618884:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.620609:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000023eb01b7 reply state 000000001e5d0186 transno 8589950663 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.620628:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580311.620758:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283021:x1863919946622592:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2135us (3874us total) trans 8589950663 rc 0/0 00000100:00100000:2.0:1777580311.620770:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19406 00000100:00100000:2.0:1777580311.620818:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832569778758 time 7832569678758 state 0x1 ref 2 00000100:00100000:2.0:1777580311.620873:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+225:283004:x1863919946622976:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.620894:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.620913:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a64b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3c0 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.621179:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283018:x1863919946623232:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3418us (3497us total) trans 8589950662 rc 0/0 00000100:00100000:1.0:1777580311.621192:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4162 00010000:00010000:3.0:1777580311.621721:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621735:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621743:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621750:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784c000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.621756:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621765:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621783:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0249f66f200) 00010000:00010000:3.0:1777580311.621787:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.621792:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621799:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4a62f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.621863:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832569778758 time 7832570723429 state 0x0 ref 2 00000100:00100000:3.0:1777580311.621882:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+224:283017:x1863919946622720:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580311.621896:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.621914:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4a652 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3b9 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621979:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4a652 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x815:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b9 expref: 225 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.621992:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4a652 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x815:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b9 expref: 225 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.623192:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa02488b77500) 00010000:00010000:3.0:1777580311.623200:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580311.623204:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8200, rc 0) 00000100:00100000:3.0:1777580311.623283:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+225:283017:x1863919946622720:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1403us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.623293:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19408 00010000:00010000:2.0:1777580311.627453:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.627484:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.627499:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.627518:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.627525:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.627532:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.628371:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15aa:0x0], index 1: 0 00010000:00010000:2.0:1777580311.628685:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a667 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628700:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628712:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628758:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628778:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628785:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628792:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.628797:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628805:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628818:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.628821:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.628827:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628845:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a659 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.628862:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed1117a6 reply state 00000000432e0336 transno 8589950664 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.628872:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.628919:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a64b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c0 expref: 226 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628936:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a667 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c0 expref: 225 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.628956:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024acb3ec00) 00010000:00010000:2.0:1777580311.628959:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.628962:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:2.0:1777580311.629065:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283004:x1863919946622976:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8234us (12146us total) trans 8589950664 rc 0/0 00000100:00100000:2.0:1777580311.629076:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19407 00000100:00100000:2.0:1777580311.629086:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832569778758 time 7832570723429 state 0x2 ref 0 00000100:00100000:0.0:1777580311.635091:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.640082:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946623488 00000100:00100000:1.0:1777580311.640102:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946623488 00000100:00100000:1.0:1777580311.640208:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4163 00000100:00100000:1.0:1777580311.640221:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283019:x1863919946623488:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.641949:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+227:283019:x1863919946623488:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1715us (6854us total) trans 8589950665 rc 0/0 00000100:00100000:1.0:1777580311.641966:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4163 00000100:00100000:2.0:1777580311.645406:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.645460:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580311.645495:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645509:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645516:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645523:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.645528:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645536:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645558:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa024acb3ef00) 00010000:00010000:2.0:1777580311.645562:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.645577:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645577:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645585:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a644 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.645586:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.645592:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.645596:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.645598:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.645604:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.645623:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024acb3e700) 00010000:00010000:3.0:1777580311.645625:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.645629:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.645631:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946623616 00010000:00010000:3.0:1777580311.645634:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a660 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.645643:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946623616 00000100:00100000:2.0:1777580311.645685:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832569778758 time 7832570723429 state 0x0 ref 1 00000100:00100000:2.0:1777580311.645697:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832570823429 time 7832570723429 state 0x1 ref 1 00000100:00100000:2.0:1777580311.645724:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832570823429 time 7832594586469 state 0x0 ref 1 00000100:00100000:2.0:1777580311.645736:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283021:x1863919946623616:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.645768:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.645792:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a675 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3c7 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.645820:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946623744 00000100:00100000:3.0:1777580311.645823:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946623744 00000100:00100000:3.0:1777580311.645867:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11826 00000100:00100000:3.0:1777580311.645874:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2362:x1863919946623744:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:2.0:1777580311.645908:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a675 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x816:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c7 expref: 226 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645924:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a675 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x816:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c7 expref: 226 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.645942:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:2.0:1777580311.645945:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580311.645948:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:2.0:1777580311.646012:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283021:x1863919946623616:12345-192.168.202.9@tcp:101:touch.500 Request processed in 277us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.646029:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19409 00000100:00100000:2.0:1777580311.646034:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832570823429 time 7832594586469 state 0x2 ref 0 00000100:00100000:3.0:1777580311.646381:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2362:x1863919946623744:12345-192.168.202.9@tcp:2:touch.500 Request processed in 506us (920us total) trans 8589938567 rc 0/0 00000100:00100000:3.0:1777580311.646389:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11826 00000100:00100000:2.0:1777580311.662396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.663490:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624128 00000100:00100000:1.0:1777580311.663504:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624128 00000100:00100000:1.0:1777580311.663556:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832176825512 time 7832275048782 state 0x0 ref 1 00000100:00100000:1.0:1777580311.663572:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275148782 time 7832275048782 state 0x1 ref 1 00000100:00100000:1.0:1777580311.663599:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275148782 time 7832612462004 state 0x0 ref 1 00000100:00100000:1.0:1777580311.663622:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+226:283033:x1863919946624128:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.663652:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.663805:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a67c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3ce expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663905:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663922:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663936:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663953:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663960:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.663967:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664089:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664098:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664105:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.664174:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x814:0x0]: returning size 0 00000004:00200000:1.0:1777580311.664178:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.664199:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664212:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664221:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664228:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664236:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664242:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.664246:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664253:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664265:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.664268:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.664273:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.664279:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a683 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665492:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665500:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665508:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665514:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.665518:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665526:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665539:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02484c59c00) 00010000:00010000:1.0:1777580311.665543:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.665546:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665552:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a68a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665608:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a67c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ce expref: 228 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665625:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ce expref: 227 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.665643:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:1.0:1777580311.665645:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.665648:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00000100:00100000:1.0:1777580311.665744:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+227:283033:x1863919946624128:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2125us (3470us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.665755:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19410 00000100:00100000:1.0:1777580311.665764:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275148782 time 7832612462004 state 0x2 ref 0 00000100:00100000:0.0:1777580311.671238:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.672937:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624256 00000100:00100000:0.0:1777580311.672953:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624256 00000100:00100000:0.0:1777580311.673022:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11827 00000100:00100000:0.0:1777580311.673033:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946624256:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580311.673445:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946624256:12345-192.168.202.9@tcp:2:touch.500 Request processed in 412us (2221us total) trans 8589938968 rc 0/0 00000100:00100000:0.0:1777580311.673454:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11827 00000100:00100000:0.0:1777580311.673533:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.673673:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.674277:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624512 00000100:00100000:1.0:1777580311.674296:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624512 00000100:00100000:1.0:1777580311.674343:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4164 00000100:00100000:1.0:1777580311.674351:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+227:283017:x1863919946624512:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.674709:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+228:283017:x1863919946624512:12345-192.168.202.9@tcp:35:touch.500 Request processed in 358us (1175us total) trans 8589950666 rc 0/0 00000100:00100000:1.0:1777580311.674717:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4164 00000100:00100000:3.0:1777580311.676080:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624000 00000100:00100000:3.0:1777580311.676092:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624000 00000100:00100000:3.0:1777580311.676149:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832570823429 time 7832594586469 state 0x0 ref 1 00000100:00100000:3.0:1777580311.676164:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832594686469 time 7832594586469 state 0x1 ref 1 00000100:00100000:3.0:1777580311.676190:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832594686469 time 7832625052913 state 0x0 ref 1 00000100:00100000:3.0:1777580311.676206:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+228:283004:x1863919946624000:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580311.676257:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.676292:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a667 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c0 expref: 228 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.676324:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024acb3ec00) 00010000:00010000:3.0:1777580311.676335:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580311.676417:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.676446:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.676459:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.676602:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000da2f52e6 reply state 00000000eda5969f transno 8589950667 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.676611:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580311.676707:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+229:283004:x1863919946624000:12345-192.168.202.9@tcp:36:touch.500 Request processed in 505us (3032us total) trans 8589950667 rc 0/0 00000100:00100000:3.0:1777580311.676716:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19411 00000100:00100000:3.0:1777580311.676721:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832594686469 time 7832625052913 state 0x2 ref 0 00000100:00100000:0.0:1777580311.690316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.690372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.690515:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624640 00000100:00100000:0.0:1777580311.690527:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624640 00000100:00100000:0.0:1777580311.690588:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11828 00000100:00100000:0.0:1777580311.690601:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946624640:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.690643:0:206020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.690674:0:206020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3d5 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.690707:0:206020:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15cd:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.690734:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.690737:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1777580311.690745:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946624896 00010000:00010000:0.0:1777580311.690747:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 37 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.690749:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946624896 00010000:00010000:0.0:1777580311.690767:0:206020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 37 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.690778:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832594686469 time 7832625052913 state 0x0 ref 1 00010000:00010000:0.0:1777580311.690782:0:206020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fa00, rc 0) 00000100:00100000:2.0:1777580311.690789:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832625152913 time 7832625052913 state 0x1 ref 1 00000100:00100000:0.0:1777580311.690866:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2363:x1863919946624640:12345-192.168.202.9@tcp:101:rm.500 Request processed in 268us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.690873:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11828 00000100:00100000:2.0:1777580311.691037:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832625152913 time 7832639897967 state 0x0 ref 1 00000100:00100000:2.0:1777580311.691050:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+229:283020:x1863919946624896:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.691063:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.691079:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a6a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3dc expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691276:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691300:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691312:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691328:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691349:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.691357:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.691939:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15cf:0x0], index 0: 0 00010000:00010000:2.0:1777580311.692161:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a6bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692174:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692184:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692225:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692233:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692241:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692247:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.692252:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692259:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692287:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.692290:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.692295:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692302:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.692317:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000efb3d404 reply state 00000000866f4c23 transno 8589950668 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.692326:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.692363:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a6a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3dc expref: 232 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692377:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a6bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3dc expref: 231 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.692386:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580311.692388:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.692391:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:2.0:1777580311.692455:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+232:283020:x1863919946624896:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1408us (2083us total) trans 8589950668 rc 0/0 00000100:00100000:2.0:1777580311.692464:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19412 00000100:00100000:2.0:1777580311.692471:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832625152913 time 7832639897967 state 0x2 ref 0 00010000:00010000:2.0:1777580311.701151:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701185:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701193:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701200:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.701206:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701214:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701235:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa02488b77200) 00010000:00010000:2.0:1777580311.701238:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.701244:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.701250:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4a698 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.701275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.706078:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625152 00000100:00100000:3.0:1777580311.706098:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625152 00000100:00100000:3.0:1777580311.706565:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4165 00000100:00100000:3.0:1777580311.706578:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+231:283021:x1863919946625152:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580311.710079:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+232:283021:x1863919946625152:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3490us (8794us total) trans 8589950669 rc 0/0 00000100:00100000:3.0:1777580311.710106:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4165 00000100:00100000:3.0:1777580311.710240:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.710276:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625280 00000100:00100000:2.0:1777580311.710287:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625280 00000100:00100000:2.0:1777580311.710328:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832625152913 time 7832639897967 state 0x0 ref 1 00000100:00100000:2.0:1777580311.710341:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832639997967 time 7832639897967 state 0x1 ref 1 00000100:00100000:2.0:1777580311.710366:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832639997967 time 7832659227622 state 0x0 ref 1 00000100:00100000:2.0:1777580311.710377:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+232:283004:x1863919946625280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.710409:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.710440:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a6c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3e3 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.710501:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x817:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3e3 expref: 233 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.710520:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x817:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3e3 expref: 233 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.710540:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:2.0:1777580311.710543:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580311.710547:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:2.0:1777580311.710582:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+233:283004:x1863919946625280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 207us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.710589:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19413 00000100:00100000:2.0:1777580311.710593:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832639997967 time 7832659227622 state 0x2 ref 0 00000100:00100000:3.0:1777580311.711872:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.712041:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.712076:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.712102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.712181:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625792 00000100:00100000:3.0:1777580311.712190:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625792 00000100:00100000:3.0:1777580311.712232:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625664 00000100:00100000:3.0:1777580311.712235:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625664 00000100:00100000:0.0:1777580311.712327:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 330 00000100:00100000:0.0:1777580311.712341:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946625792:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580311.712447:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946625792:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 110us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.712454:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 330 00000100:00100000:0.0:1777580311.712482:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625408 00000100:00100000:0.0:1777580311.712487:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625408 00000100:00100000:0.0:1777580311.712515:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 421 00000100:00100000:0.0:1777580311.712521:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946625408:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580311.712560:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946625408:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.712566:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 421 00000100:00100000:1.0:1777580311.715578:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946625536 00000100:00100000:1.0:1777580311.715594:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946625536 00000100:00100000:1.0:1777580311.715642:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 495 00000100:00100000:1.0:1777580311.715654:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:2364:x1863919946625536:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580311.715760:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:2364:x1863919946625536:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 109us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.715768:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 495 00000100:00080000:1.0:1777580311.715794:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777580311.716015:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 331 00000100:00100000:3.0:1777580311.716025:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946625664:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580311.716077:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946625664:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 54us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.716084:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 331 00010000:00010000:3.0:1777580311.728378:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728398:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728407:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728413:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580311.728420:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728517:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728539:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024ad9fdf00) 00010000:00010000:3.0:1777580311.728543:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580311.728549:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.728557:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4a6b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.736641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.736675:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.737047:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626176 00000100:00100000:2.0:1777580311.737061:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626176 00000100:00100000:2.0:1777580311.737109:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832275148782 time 7832612462004 state 0x0 ref 1 00000100:00100000:2.0:1777580311.737125:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832612562004 time 7832612462004 state 0x1 ref 1 00000100:00100000:2.0:1777580311.737165:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626304 00000100:00100000:2.0:1777580311.737168:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626304 00000100:00100000:2.0:1777580311.737180:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832612562004 time 7832612462004 state 0x1 ref 2 00000100:00100000:3.0:1777580311.737192:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.737199:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686161504 time 7832686061504 state 0x1 ref 2 00000100:00100000:3.0:1777580311.737214:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.737218:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+233:283026:x1863919946626176:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:3.0:1777580311.737234:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.737258:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626048 00000100:00100000:3.0:1777580311.737262:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626048 00000100:00100000:3.0:1777580311.737281:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832639997967 time 7832659227622 state 0x0 ref 1 00000100:00100000:3.0:1777580311.737289:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832659327622 time 7832659227622 state 0x1 ref 1 00000100:00100000:3.0:1777580311.737304:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626688 00000100:00100000:3.0:1777580311.737306:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626688 00000100:00100000:3.0:1777580311.737317:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686161504 time 7832686061504 state 0x1 ref 3 00000100:00100000:3.0:1777580311.737325:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626816 00000100:00100000:3.0:1777580311.737327:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626816 00000100:00100000:3.0:1777580311.737337:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686161504 time 7832686061504 state 0x1 ref 4 00000100:00100000:3.0:1777580311.737360:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832659327622 time 7832686223462 state 0x0 ref 1 00000100:00100000:3.0:1777580311.737370:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+236:283020:x1863919946626048:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:1.0:1777580311.737936:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686897004 time 7832686797004 state 0x1 ref 4 00000100:00100000:1.0:1777580311.737959:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+236:283028:x1863919946626304:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.737972:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.737997:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a6d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3f1 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738280:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.738299:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a6d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3ea expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738364:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738381:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738395:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738412:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738420:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738426:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738551:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738560:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738568:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.738611:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80c:0x0]: returning size 0 00000004:00200000:2.0:1777580311.738615:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.738638:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738652:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738661:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738669:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738676:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738683:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.738687:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738694:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738707:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.738710:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.738714:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738722:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a6de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738745:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738752:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738759:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738764:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.738766:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738772:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738778:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024ad9fd100) 00010000:00010000:2.0:1777580311.738780:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.738783:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738788:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4a6e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738821:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4a6d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ea expref: 238 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738843:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ea expref: 237 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.738862:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02484c59800) 00010000:00010000:2.0:1777580311.738864:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.738867:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:2.0:1777580311.738947:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+237:283026:x1863919946626176:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1731us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.738957:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19414 00000100:00100000:2.0:1777580311.738994:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832687956094 time 7832687856094 state 0x1 ref 3 00000100:00100000:2.0:1777580311.739007:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+236:283031:x1863919946626688:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.739018:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.739028:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a6f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e406 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739063:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739073:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739081:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739095:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739101:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739123:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739217:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.739229:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739236:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4a6bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3dc expref: 237 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739237:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739244:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739248:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:3.0:1777580311.739255:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1777580311.739266:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x811:0x0]: returning size 0 00000004:00200000:2.0:1777580311.739269:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.739280:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739288:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739294:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739300:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739305:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739311:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.739314:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739317:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739326:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739326:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.739334:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739335:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.739337:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.739340:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739345:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4a6fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739355:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739359:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739364:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739368:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.739370:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739376:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739382:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa024ad9fd800) 00010000:00010000:2.0:1777580311.739384:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.739387:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739399:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a701 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739420:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4a6f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e406 expref: 237 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739430:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e406 expref: 236 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739438:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:2.0:1777580311.739440:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.739443:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:2.0:1777580311.739471:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+236:283031:x1863919946626688:12345-192.168.202.9@tcp:101:rm.500 Request processed in 467us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.739478:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19417 00000100:00100000:2.0:1777580311.739501:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832687956094 time 7832688363368 state 0x0 ref 2 00000100:00100000:2.0:1777580311.739511:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+235:283035:x1863919946626816:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.739520:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.739529:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4a716 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e40d expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739556:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.739558:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739563:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739580:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739590:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739596:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739602:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580311.739639:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d1f4c94 reply state 00000000050484b1 transno 8589950670 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739648:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.739649:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580311.739655:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739662:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.739679:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x815:0x0]: returning size 0 00000004:00200000:2.0:1777580311.739682:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.739690:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.739698:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.740800:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+239:283020:x1863919946626048:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3421us (3597us total) trans 8589950670 rc 0/0 00000100:00100000:3.0:1777580311.740813:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19416 00000100:00100000:3.0:1777580311.740822:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832659327622 time 7832686223462 state 0x2 ref 0 00010000:00010000:1.0:1777580311.743320:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.743350:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.743387:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743388:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.743397:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.743404:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743412:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743418:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743424:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.743429:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743438:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743454:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.743457:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.743463:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743469:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4a71d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743491:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743498:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743504:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743510:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.743520:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743527:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743536:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024ad9fd000) 00010000:00010000:2.0:1777580311.743538:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.743542:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743547:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4a72b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743608:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4a716 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e40d expref: 239 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743625:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e40d expref: 238 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.743632:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580311.743634:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.743637:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997f400, rc 0) 00000100:00100000:2.0:1777580311.743718:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+238:283035:x1863919946626816:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4206us (6480us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.743730:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19418 00000100:00100000:2.0:1777580311.743876:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.743961:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.744058:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.744149:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627456 00000100:00100000:2.0:1777580311.744157:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626944 00000100:00100000:0.0:1777580311.744161:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627456 00000100:00100000:2.0:1777580311.744166:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626944 00000100:00100000:2.0:1777580311.744202:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832688463368 time 7832688363368 state 0x1 ref 2 00000100:00100000:0.0:1777580311.744211:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11829 00000100:00100000:2.0:1777580311.744218:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626432 00000100:00100000:0.0:1777580311.744219:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2363:x1863919946627456:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580311.744220:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626432 00000100:00100000:2.0:1777580311.744231:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832688463368 time 7832688363368 state 0x1 ref 3 00000100:00100000:2.0:1777580311.744887:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832693846134 time 7832693746134 state 0x1 ref 3 00000100:00100000:2.0:1777580311.744903:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+239:283030:x1863919946626944:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.744918:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.744938:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4a740 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e414 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745012:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745028:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745039:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745056:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745063:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.745070:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745234:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745243:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745252:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.745297:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80e:0x0]: returning size 0 00000004:00200000:1.0:1777580311.745302:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.745325:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745338:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745346:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745351:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745357:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745363:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.745367:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745373:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745383:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.745386:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.745390:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745395:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a724 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745419:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745425:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745639:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745644:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.745648:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745654:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745663:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02484c59c00) 00010000:00010000:1.0:1777580311.745666:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.745668:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745673:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a739 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745708:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a6d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f1 expref: 241 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745723:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f1 expref: 240 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745742:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa02491fc3500) 00010000:00010000:1.0:1777580311.745744:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.745747:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838800, rc 0) 00000100:00100000:1.0:1777580311.745842:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+240:283028:x1863919946626304:12345-192.168.202.9@tcp:101:rm.500 Request processed in 7875us (9156us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.745851:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19415 00000100:00100000:1.0:1777580311.745889:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832693846134 time 7832694749911 state 0x0 ref 2 00000100:00100000:1.0:1777580311.745902:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+239:283027:x1863919946626432:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.745914:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.745926:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a75c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3f8 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745964:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745972:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745979:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745992:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.745999:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.747189:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.747334:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.747348:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.747356:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747382:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.747389:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80d:0x0]: returning size 0 00010000:00010000:2.0:1777580311.747392:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.747394:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1777580311.747400:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580311.747416:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.747417:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x810:0x0]: returning size 0 00000004:00200000:2.0:1777580311.747419:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.747427:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747436:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747446:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747452:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747458:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747464:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.747469:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747476:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747497:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.747500:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.747505:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747512:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4a747 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747528:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747534:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747540:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747545:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.747547:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747552:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747559:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa024acb3ec00) 00010000:00010000:2.0:1777580311.747561:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.747563:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747568:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a74e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747617:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4a740 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e414 expref: 241 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747632:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e414 expref: 240 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.747639:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02499549700) 00010000:00010000:2.0:1777580311.747641:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.747644:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:0.0:1777580311.747696:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946627456:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3475us (3635us total) trans 8589938568 rc 0/0 00000100:00100000:0.0:1777580311.747708:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11829 00000100:00100000:2.0:1777580311.747889:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+240:283030:x1863919946626944:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2990us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.747899:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19419 00010000:00010000:1.0:1777580311.748608:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748625:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748633:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748641:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748646:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.748651:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748668:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748682:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.748685:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.748689:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748695:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1ce00/0xcb2b2f2f7e4a763 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748710:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748716:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748721:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748726:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1cc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.748729:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748735:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748742:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02493bbda00) 00010000:00010000:1.0:1777580311.748744:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.748747:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748761:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a76a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748807:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a75c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 240 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748821:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 239 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.748828:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580311.748831:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.748842:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c800, rc 0) 00000100:00100000:1.0:1777580311.748888:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+239:283027:x1863919946626432:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2989us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.748898:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19420 00000100:00100000:1.0:1777580311.748906:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832693846134 time 7832694749911 state 0x2 ref 0 00000100:00100000:2.0:1777580311.759817:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.759873:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.759995:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946626560 00000100:00100000:2.0:1777580311.760007:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946626560 00000100:00100000:2.0:1777580311.760052:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832693846134 time 7832694749911 state 0x0 ref 1 00000100:00100000:2.0:1777580311.760066:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832694849911 time 7832694749911 state 0x1 ref 1 00000100:00100000:2.0:1777580311.760085:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627072 00000100:00100000:2.0:1777580311.760087:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627072 00000100:00100000:2.0:1777580311.760098:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832694849911 time 7832694749911 state 0x1 ref 2 00000100:00100000:2.0:1777580311.760115:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709078311 time 7832708978311 state 0x1 ref 2 00000100:00100000:2.0:1777580311.760126:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+240:283024:x1863919946626560:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.760183:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.760210:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4a77f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e3ff expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760307:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760325:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760339:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760356:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760363:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760370:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760502:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760511:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760518:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.760550:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80a:0x0]: returning size 0 00000004:00200000:2.0:1777580311.760559:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.760583:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760598:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760606:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760614:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760621:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760627:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.760631:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760638:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760650:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.760653:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.760658:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760665:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4a786 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760677:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760692:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760698:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760703:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.760706:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760712:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760718:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024acb3e700) 00010000:00010000:2.0:1777580311.760720:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.760723:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760728:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4a78d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760758:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4a77f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ff expref: 242 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760771:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ff expref: 241 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760779:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580311.760781:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.760788:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ee00, rc 0) 00000100:00100000:2.0:1777580311.760871:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+241:283024:x1863919946626560:12345-192.168.202.9@tcp:101:rm.500 Request processed in 746us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.760880:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19421 00000100:00100000:2.0:1777580311.760907:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709078311 time 7832709769418 state 0x0 ref 1 00000100:00100000:2.0:1777580311.760917:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+240:283029:x1863919946627072:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.760925:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.760936:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4a79b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e41b expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760967:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760975:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760983:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.760994:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761001:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761007:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761062:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761081:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761087:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580311.761111:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80f:0x0]: returning size 0 00000004:00200000:2.0:1777580311.761113:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580311.761123:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761131:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761206:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761211:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761217:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761222:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.761224:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761230:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761237:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.761244:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.761248:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761253:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4a7a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761263:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761268:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761273:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761278:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.761280:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761286:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761293:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024acb3ef00) 00010000:00010000:2.0:1777580311.761295:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.761297:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761302:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4a7a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761323:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4a79b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e41b expref: 242 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761341:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e41b expref: 241 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761349:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:2.0:1777580311.761351:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580311.761353:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5000, rc 0) 00000100:00100000:2.0:1777580311.761386:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+241:283029:x1863919946627072:12345-192.168.202.9@tcp:101:rm.500 Request processed in 470us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.761394:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19422 00000100:00100000:2.0:1777580311.761398:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709078311 time 7832709769418 state 0x2 ref 0 00010000:00010000:2.0:1777580311.761428:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761434:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761441:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761445:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.761448:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761455:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761463:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580311.761471:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.761475:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.761481:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4a70f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.767273:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.767313:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.767357:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000001:00080000:2.0:1777580311.770595:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950660 is committed 00000001:00080000:2.0:1777580311.770639:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950609 is committed 00000004:00080000:2.0:1777580311.770706:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 203 committed 00000001:00080000:2.0:1777580311.770766:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950661 is committed 00000004:00080000:2.0:1777580311.771930:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 205 committed 00000004:00080000:2.0:1777580311.772000:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 210 committed 00000004:00080000:2.0:1777580311.772151:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 202 committed 00000004:00080000:2.0:1777580311.772218:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 211 committed 00000004:00080000:2.0:1777580311.772284:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 204 committed 00000001:00080000:2.0:1777580311.772457:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950612 is committed 00000004:00080000:2.0:1777580311.772572:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 209 committed 00000004:00080000:2.0:1777580311.772608:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 208 committed 00000100:00100000:2.0:1777580311.772984:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917458944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.773083:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917459072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.773111:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917459200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.773166:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917459328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580311.776306:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.776344:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.776374:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.776467:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627968 00000100:00100000:2.0:1777580311.776479:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627968 00000100:00100000:2.0:1777580311.776531:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832659327622 time 7832686223462 state 0x0 ref 1 00000100:00100000:2.0:1777580311.776547:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686323462 time 7832686223462 state 0x1 ref 1 00000100:00100000:2.0:1777580311.776590:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686323462 time 7832725452090 state 0x0 ref 1 00000100:00100000:2.0:1777580311.776605:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283020:x1863919946627968:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580311.776638:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.776671:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a7b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e445 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.776749:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x818:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e445 expref: 74 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.776768:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x818:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e445 expref: 74 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.776791:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580311.776795:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580311.776799:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7400, rc 0) 00000100:00100000:2.0:1777580311.776886:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283020:x1863919946627968:12345-192.168.202.9@tcp:101:touch.500 Request processed in 283us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.776894:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19423 00000100:00100000:2.0:1777580311.776900:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686323462 time 7832725452090 state 0x2 ref 0 00000100:00100000:0.0:1777580311.780858:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627584 00000100:00100000:0.0:1777580311.780879:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627584 00000100:00100000:0.0:1777580311.781121:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627712 00000100:00100000:0.0:1777580311.781126:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627712 00000100:00100000:0.0:1777580311.781198:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627840 00000100:00100000:0.0:1777580311.781201:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627840 00000100:00100000:0.0:1777580311.781231:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11830 00000100:00100000:0.0:1777580311.781241:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2361:x1863919946627712:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.781266:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.781293:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e437 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.781327:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ca:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.781351:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781353:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781364:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781397:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781413:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f400, rc 0) 00000100:00100000:0.0:1777580311.781505:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946627712:12345-192.168.202.9@tcp:101:rm.500 Request processed in 265us (14189us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.781512:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11830 00000100:00100000:0.0:1777580311.781536:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11831 00000100:00100000:0.0:1777580311.781543:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2361:x1863919946627840:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.781550:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.781560:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e43e expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.781574:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15cb:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.781582:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781584:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781587:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781598:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781606:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248784c000, rc 0) 00000100:00100000:0.0:1777580311.781626:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946627840:12345-192.168.202.9@tcp:101:rm.500 Request processed in 85us (14270us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.781639:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11831 00000100:00100000:0.0:1777580311.781693:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11832 00000100:00100000:0.0:1777580311.781700:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2361:x1863919946627584:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580311.781707:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.781720:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e430 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580311.781735:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c9:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580311.781744:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781745:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.781750:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 40 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781759:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 40 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.781767:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248784ca00, rc 0) 00000100:00100000:0.0:1777580311.781786:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946627584:12345-192.168.202.9@tcp:101:rm.500 Request processed in 88us (14526us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.781792:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11832 00000100:00100000:3.0:1777580311.784226:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.784270:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.784608:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.784634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.784675:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.784717:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628352 00000100:00100000:3.0:1777580311.784728:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628352 00000100:00100000:3.0:1777580311.784792:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628480 00000100:00100000:3.0:1777580311.784795:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628480 00000100:00100000:3.0:1777580311.784908:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628608 00000100:00100000:3.0:1777580311.784912:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628608 00000100:00100000:3.0:1777580311.784931:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628736 00000100:00100000:3.0:1777580311.784933:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628736 00000100:00100000:3.0:1777580311.784956:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11833 00000100:00100000:3.0:1777580311.784967:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2364:x1863919946628352:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580311.784989:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580311.785015:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e44c expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580311.785050:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a9:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:3.0:1777580311.785075:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.785077:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.785088:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 42 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.785131:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 42 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.785418:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628224 00000100:00100000:1.0:1777580311.785425:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628224 00000100:00100000:1.0:1777580311.785466:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4166 00000100:00100000:1.0:1777580311.785474:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283004:x1863919946628224:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.785927:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283004:x1863919946628224:12345-192.168.202.9@tcp:35:touch.500 Request processed in 453us (9580us total) trans 8589950671 rc 0/0 00000100:00100000:1.0:1777580311.785937:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4166 00000100:00100000:1.0:1777580311.786019:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11834 00000100:00100000:1.0:1777580311.786028:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946628480:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.786051:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.786071:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e453 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580311.786096:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a5:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:1.0:1777580311.786111:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786113:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786120:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 43 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786172:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 43 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786188:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1ce00, rc 0) 00000100:00100000:1.0:1777580311.786211:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946628480:12345-192.168.202.9@tcp:101:rm.500 Request processed in 185us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.786216:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11834 00000100:00100000:1.0:1777580311.786232:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11835 00000100:00100000:1.0:1777580311.786238:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946628608:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.786246:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.786255:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e45a expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580311.786268:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a7:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:1.0:1777580311.786276:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786284:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786289:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 43 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786301:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 43 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786311:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1d400, rc 0) 00000100:00100000:1.0:1777580311.786331:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946628608:12345-192.168.202.9@tcp:101:rm.500 Request processed in 94us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.786337:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11835 00000100:00100000:1.0:1777580311.786350:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11836 00000100:00100000:1.0:1777580311.786357:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946628736:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.786365:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.786378:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e461 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580311.786394:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15c8:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:1.0:1777580311.786402:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786403:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.786407:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 41 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786417:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 41 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786438:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1de00, rc 0) 00000100:00100000:1.0:1777580311.786457:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2361:x1863919946628736:12345-192.168.202.9@tcp:101:rm.500 Request processed in 101us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.786462:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11836 00000100:00100000:1.0:1777580311.786486:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627200 00000100:00100000:1.0:1777580311.786492:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627200 00000100:00100000:1.0:1777580311.786515:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709078311 time 7832709769418 state 0x0 ref 1 00000100:00100000:1.0:1777580311.786526:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709869418 time 7832709769418 state 0x1 ref 1 00000100:00100000:1.0:1777580311.786545:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946627328 00000100:00100000:1.0:1777580311.786547:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946627328 00000100:00100000:1.0:1777580311.786556:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832709869418 time 7832709769418 state 0x1 ref 2 00000100:00100000:1.0:1777580311.786570:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832735533547 time 7832735433547 state 0x1 ref 2 00000100:00100000:1.0:1777580311.786578:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283032:x1863919946627200:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.786587:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.786601:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4a7ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e422 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786657:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786672:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786682:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786707:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786714:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786720:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786853:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786864:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786871:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.786900:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x812:0x0]: returning size 0 00000004:00200000:1.0:1777580311.786905:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.786924:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786936:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786946:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786952:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786969:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786976:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.786981:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.786989:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787001:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.787004:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.787008:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787014:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4a7f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787029:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787035:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787040:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787044:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.787047:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787061:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787068:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024185ac100) 00010000:00010000:1.0:1777580311.787071:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.787074:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787080:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4a7fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787114:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4a7ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e422 expref: 78 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787126:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e422 expref: 77 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787168:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02499549300) 00010000:00010000:1.0:1777580311.787171:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.787173:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1cc00, rc 0) 00000100:00100000:1.0:1777580311.787206:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283032:x1863919946627200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 627us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.787213:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19424 00000100:00100000:1.0:1777580311.787235:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832735533547 time 7832736098575 state 0x0 ref 1 00000100:00100000:1.0:1777580311.787246:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238941ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283034:x1863919946627328:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580311.787255:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.787272:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a80b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e429 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787308:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787316:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787323:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787334:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787340:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787346:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787406:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787414:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787420:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.787439:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x813:0x0]: returning size 0 00000004:00200000:1.0:1777580311.787442:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580311.787451:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787466:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787473:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787479:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787485:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787491:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.787494:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787501:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787508:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.787511:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.787513:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787518:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4a812 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787527:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787532:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787546:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787550:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.787553:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787559:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787566:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024185aaf00) 00010000:00010000:1.0:1777580311.787568:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.787570:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787576:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4a819 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787599:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4a80b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e429 expref: 78 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787611:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e429 expref: 77 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.787617:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02499549a00) 00010000:00010000:1.0:1777580311.787620:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.787622:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838200, rc 0) 00000100:00100000:1.0:1777580311.787646:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238941ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283034:x1863919946627328:12345-192.168.202.9@tcp:101:rm.500 Request processed in 402us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.787660:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19425 00000100:00100000:1.0:1777580311.787665:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832735533547 time 7832736098575 state 0x2 ref 0 00010000:00010000:3.0:1777580311.788646:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9a00, rc 0) 00000100:00100000:3.0:1777580311.788695:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2364:x1863919946628352:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3729us (12318us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.788704:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11833 00000100:00100000:3.0:1777580311.788911:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.789483:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789561:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917459456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.789616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789638:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917459968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.789664:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789704:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917460480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.789726:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789769:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789792:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917459584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.789829:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789858:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917460096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.789876:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789893:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917460608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.789916:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789947:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.789969:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917459712:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.789992:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790009:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917460224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.790028:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790045:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917460736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.790063:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790095:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790116:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917459840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.790169:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790195:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917460352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.790215:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790231:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917460864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.790251:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.790311:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628864 00000100:00100000:2.0:1777580311.790320:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628864 00000100:00100000:2.0:1777580311.790371:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917458944 00000100:00100000:2.0:1777580311.790375:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917458944 00000100:00100000:2.0:1777580311.790402:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459456 00000100:00100000:2.0:1777580311.790404:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459456 00000100:00100000:2.0:1777580311.790413:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459968 00000100:00100000:2.0:1777580311.790415:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459968 00000100:00100000:2.0:1777580311.790429:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460480 00000100:00100000:2.0:1777580311.790432:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460480 00000100:00100000:2.0:1777580311.790441:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459072 00000100:00100000:2.0:1777580311.790443:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459072 00000100:00100000:2.0:1777580311.790452:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459584 00000100:00100000:2.0:1777580311.790454:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459584 00000100:00100000:2.0:1777580311.790462:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460096 00000100:00100000:2.0:1777580311.790464:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460096 00000100:00100000:2.0:1777580311.790471:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460608 00000100:00100000:2.0:1777580311.790474:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460608 00000100:00100000:2.0:1777580311.790482:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459200 00000100:00100000:2.0:1777580311.790484:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459200 00000100:00100000:2.0:1777580311.790492:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459712 00000100:00100000:2.0:1777580311.790494:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459712 00000100:00100000:2.0:1777580311.790501:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460224 00000100:00100000:2.0:1777580311.790503:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460224 00000100:00100000:2.0:1777580311.790511:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460736 00000100:00100000:2.0:1777580311.790513:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460736 00000100:00100000:2.0:1777580311.790522:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459328 00000100:00100000:2.0:1777580311.790525:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459328 00000100:00100000:2.0:1777580311.790533:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917459840 00000100:00100000:2.0:1777580311.790535:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917459840 00000100:00100000:2.0:1777580311.790543:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460352 00000100:00100000:2.0:1777580311.790545:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460352 00000100:00100000:2.0:1777580311.790552:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917460864 00000100:00100000:2.0:1777580311.790554:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917460864 00000100:00100000:2.0:1777580311.790573:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11837 00000100:00100000:2.0:1777580311.790582:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946628864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.790617:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.790643:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e468 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580311.790675:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a6:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:2.0:1777580311.790697:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.790700:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.790711:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790731:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790746:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7800, rc 0) 00000100:00100000:2.0:1777580311.790801:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946628864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 220us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.790810:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11837 00000100:00100000:2.0:1777580311.790832:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11838 00000100:00100000:2.0:1777580311.790852:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917458944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.790874:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5500 count 1 00010000:00010000:2.0:1777580311.790892:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790909:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 23 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790929:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.790930:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.790934:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790975:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 23 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.790991:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 23 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791005:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917460992:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791054:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791083:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11839 00000100:00100000:2.0:1777580311.791090:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917459456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.791104:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5502 count 1 00010000:00010000:2.0:1777580311.791118:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791131:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791171:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791173:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791182:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791204:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791212:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791222:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917461120:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791250:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791269:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11840 00000100:00100000:2.0:1777580311.791277:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917459968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.791293:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5534 count 1 00010000:00010000:2.0:1777580311.791311:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791325:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 26 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791332:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791334:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791336:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791357:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 26 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791380:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 26 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791390:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917461248:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791415:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae242c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791435:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11841 00000100:00100000:2.0:1777580311.791444:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917460480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.791457:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5537 count 1 00010000:00010000:2.0:1777580311.791470:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791483:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 26 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791489:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791491:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791493:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791513:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 26 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791522:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 26 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791545:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917461376:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791570:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791612:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11842 00000100:00100000:2.0:1777580311.791619:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917459072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.791633:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5499 count 1 00010000:00010000:2.0:1777580311.791646:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791659:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 23 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791666:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791668:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791671:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791690:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 23 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791699:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 23 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791708:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917461504:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791731:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791756:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11843 00000100:00100000:2.0:1777580311.791764:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917459584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.791778:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5505 count 1 00010000:00010000:2.0:1777580311.791792:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791805:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791812:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791814:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791817:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791854:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791864:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.791874:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917461632:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.791897:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.791914:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11844 00000100:00100000:2.0:1777580311.791922:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917460096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.791937:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5532 count 1 00010000:00010000:2.0:1777580311.791950:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791967:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 26 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791973:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791975:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.791977:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.791999:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 26 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792007:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 26 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792018:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917461760:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.792041:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393edf480 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.792061:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11845 00000100:00100000:2.0:1777580311.792068:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917460608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.792082:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5538 count 1 00010000:00010000:2.0:1777580311.792094:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792106:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 26 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792128:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792129:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792132:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792187:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 26 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792197:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 26 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792208:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917461888:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.792237:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02388620b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.792258:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11846 00000100:00100000:2.0:1777580311.792267:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917459200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.792282:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5501 count 1 00010000:00010000:2.0:1777580311.792294:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792307:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 23 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792314:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792315:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792324:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792344:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 23 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792354:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 23 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792365:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917462016:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.792385:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248a0c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.792405:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11847 00000100:00100000:2.0:1777580311.792413:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917459712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.792427:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5503 count 1 00010000:00010000:2.0:1777580311.792440:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792452:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792458:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792459:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792461:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792479:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792501:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792511:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917462144:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.792533:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024c2c78240 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.792552:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11848 00000100:00100000:2.0:1777580311.792560:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917460224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.792575:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5536 count 1 00010000:00010000:2.0:1777580311.792589:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792601:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 26 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792609:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792610:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792613:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792633:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 26 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792643:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 26 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792666:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917462272:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.792687:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024c2c786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.792706:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11849 00000100:00100000:2.0:1777580311.792714:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917460736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.792731:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5545 count 1 00010000:00010000:2.0:1777580311.792743:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792756:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792764:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792765:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.792768:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792790:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.792800:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.792811:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917462400:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580311.793948:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11850 00000100:00100000:1.0:1777580311.793967:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917459328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580311.793993:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5504 count 1 00010000:00010000:1.0:1777580311.794018:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.794038:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.794046:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.794048:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.794051:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.794083:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.794096:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.794109:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917462528:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580311.794196:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290480 going to sleep for 11 seconds 00000100:00100000:0.0:1777580311.794649:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11851 00000100:00100000:0.0:1777580311.794663:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917459840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580311.794683:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5507 count 1 00010000:00010000:0.0:1777580311.794701:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.794732:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 42 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.794740:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.794742:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.794745:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.794769:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 42 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.794781:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 42 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.794793:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917462656:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.794941:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c600 going to sleep for 11 seconds 00000100:00100000:0.0:1777580311.794964:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11852 00000100:00100000:0.0:1777580311.794975:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917460352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580311.794991:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5535 count 1 00010000:00010000:0.0:1777580311.795007:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795021:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795039:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.795041:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.795044:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795065:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795076:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.795088:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917462784:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.795113:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1777580311.795280:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11853 00000100:00100000:0.0:1777580311.795290:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917460864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580311.795305:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5539 count 1 00010000:00010000:0.0:1777580311.795319:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795332:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 40 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795340:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 26 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795358:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.795359:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.795362:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795383:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 26 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795393:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 26 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.795403:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917462912:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.795439:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 40 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.795450:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 40 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.795459:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917463040:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.795480:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c000 going to sleep for 11 seconds 00000100:00100000:3.0:1777580311.796183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.796256:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285b40 going to sleep for 11 seconds 00000100:00080000:2.0:1777580311.796285:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777580311.796291:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777580311.800981:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946628992 00000100:00100000:2.0:1777580311.801001:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946628992 00000100:00100000:2.0:1777580311.801067:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11854 00000100:00100000:2.0:1777580311.801079:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946628992:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580311.801533:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946628992:12345-192.168.202.9@tcp:2:touch.500 Request processed in 453us (5350us total) trans 8589938969 rc 0/0 00000100:00100000:2.0:1777580311.801541:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11854 00000100:00100000:3.0:1777580311.806730:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806782:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806800:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806849:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806873:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806891:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.806973:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.807011:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629504 00000100:00100000:3.0:1777580311.807022:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629504 00010000:00010000:3.0:1777580311.807075:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 27 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807131:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630016 00000100:00100000:3.0:1777580311.807163:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630016 00010000:00010000:3.0:1777580311.807182:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 24 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807196:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629248 00000100:00100000:3.0:1777580311.807198:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629248 00010000:00010000:3.0:1777580311.807209:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 25 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807220:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629760 00000100:00100000:3.0:1777580311.807223:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629760 00010000:00010000:3.0:1777580311.807233:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 28 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807244:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630272 00000100:00100000:3.0:1777580311.807247:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630272 00010000:00010000:3.0:1777580311.807261:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807271:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630528 00000100:00100000:3.0:1777580311.807274:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630528 00010000:00010000:3.0:1777580311.807286:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 44 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807296:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630400 00000100:00100000:3.0:1777580311.807305:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630400 00010000:00010000:3.0:1777580311.807321:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 42 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807334:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629376 00000100:00100000:3.0:1777580311.807336:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629376 00010000:00010000:3.0:1777580311.807347:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 29 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807356:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629888 00000100:00100000:3.0:1777580311.807358:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629888 00010000:00010000:3.0:1777580311.807368:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 45 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807377:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629120 00000100:00100000:3.0:1777580311.807379:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629120 00010000:00010000:3.0:1777580311.807391:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 30 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.807405:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4334 00000100:00100000:3.0:1777580311.807414:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946629504:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.807434:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.807440:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 30 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807453:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 30 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807496:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807498:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807504:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807516:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807544:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.807607:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946629504:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 194us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.807616:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4334 00000100:00100000:3.0:1777580311.807678:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4335 00000100:00100000:3.0:1777580311.807685:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946630016:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.807693:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.807697:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 25 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807707:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 25 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807720:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807722:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807725:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807742:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807756:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.807774:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946630016:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 90us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.807780:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4335 00000100:00100000:3.0:1777580311.807792:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4336 00000100:00100000:3.0:1777580311.807797:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946629248:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.807804:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.807809:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 24 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807820:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 24 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807832:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807846:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807849:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807856:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807868:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.807893:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946629248:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 95us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.807900:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4336 00000100:00100000:3.0:1777580311.807913:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4337 00000100:00100000:3.0:1777580311.807919:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946629760:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.807927:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.807932:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 29 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807941:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 29 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807953:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807954:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.807958:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807965:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.807978:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.807997:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946629760:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 77us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.808003:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4337 00000100:00100000:3.0:1777580311.808016:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4338 00000100:00100000:3.0:1777580311.808023:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946630272:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.808042:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.808047:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 45 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808056:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 45 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808069:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808070:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808073:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808081:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808094:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.808111:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946630272:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 90us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.808118:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4338 00000100:00100000:3.0:1777580311.808131:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4339 00000100:00100000:3.0:1777580311.808164:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946630528:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.808172:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.808177:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 44 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808186:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 44 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808203:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808205:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808208:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808215:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808227:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.808245:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946630528:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.808252:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4339 00000100:00100000:3.0:1777580311.808267:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4340 00000100:00100000:3.0:1777580311.808273:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946630400:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.808283:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.808288:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 42 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808299:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 42 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808312:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808314:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808317:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808335:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808349:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.808369:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946630400:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 97us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.808376:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4340 00000100:00100000:3.0:1777580311.808390:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4341 00000100:00100000:3.0:1777580311.808397:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2364:x1863919946629376:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.808406:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.808411:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 28 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808420:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 28 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808433:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808434:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.808437:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.808446:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809046:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.809085:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2364:x1863919946629376:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 686us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.809094:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4341 00000100:00100000:3.0:1777580311.809161:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4342 00000100:00100000:3.0:1777580311.809171:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2364:x1863919946629888:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.809180:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.809187:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809197:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809212:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.809214:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.809218:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809225:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809239:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.809254:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2364:x1863919946629888:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 86us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.809260:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4342 00000100:00100000:3.0:1777580311.809274:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4343 00000100:00100000:3.0:1777580311.809281:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946629120:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.809297:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.809303:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 27 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809312:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 27 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809324:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.809326:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.809329:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809336:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.809349:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.809363:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946629120:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 83us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.809370:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4343 00000100:00100000:3.0:1777580311.809964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.810066:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.810102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.810175:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.810212:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580311.812247:0:188248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4808f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1580:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da89 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.812275:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917462528:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580311.812318:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.812333:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.812341:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.812353:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.812362:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.812392:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580311.813111:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917459328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19149us (23010us total) trans 8589938569 rc 0/0 00000100:00100000:1.0:1777580311.813123:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11850 00000100:00100000:1.0:1777580311.813200:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630656 00000100:00100000:1.0:1777580311.813209:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630656 00000100:00100000:1.0:1777580311.813247:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630784 00000100:00100000:1.0:1777580311.813251:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630784 00000100:00100000:3.0:1777580311.813564:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946629632 00000100:00100000:3.0:1777580311.813570:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946629632 00010000:00010000:3.0:1777580311.813603:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 24 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.813633:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946630144 00000100:00100000:3.0:1777580311.813636:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946630144 00010000:00010000:3.0:1777580311.813651:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 27 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.813664:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631168 00000100:00100000:3.0:1777580311.813666:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631168 00010000:00010000:3.0:1777580311.813679:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.813695:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4344 00000100:00100000:3.0:1777580311.813704:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946629632:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.813722:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.813727:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 24 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.813740:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 24 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.813771:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.813774:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.813779:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.813790:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814022:0:189456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e479c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8c9 expref: 27 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.814039:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917461760:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.814065:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814075:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814082:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814092:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814101:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.814161:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580311.814683:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917460096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22760us (24803us total) trans 8589938970 rc 0/0 00000100:00100000:2.0:1777580311.814694:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11844 00000100:00100000:2.0:1777580311.814729:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11855 00000100:00100000:2.0:1777580311.814740:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946630656:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.814759:0:189456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.814784:0:189456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e46f expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815038:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.815095:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946629632:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1391us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.815103:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4344 00000100:00100000:3.0:1777580311.815125:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4345 00000100:00100000:3.0:1777580311.815148:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946630144:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.815161:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.815168:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 26 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815180:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 26 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815203:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.815204:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.815209:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815218:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815231:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.815249:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946630144:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 118us (5183us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.815256:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4345 00000100:00100000:3.0:1777580311.815283:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4346 00000100:00100000:3.0:1777580311.815291:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2363:x1863919946631168:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.815299:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.815305:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815317:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 43 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815331:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.815333:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.815336:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815343:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.815357:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.815375:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2363:x1863919946631168:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 85us (5162us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.815380:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4346 00002000:00010000:2.0:1777580311.816148:0:189456:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15a8:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:2.0:1777580311.816179:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.816181:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.816189:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 43 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.816207:0:189456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 43 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.816222:0:189456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32200, rc 0) 00000100:00100000:2.0:1777580311.816270:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946630656:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1532us (9362us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.816278:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11855 00000100:00100000:2.0:1777580311.816364:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11856 00000100:00100000:2.0:1777580311.816388:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946630784:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580311.816404:0:189456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580311.816427:0:189456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e476 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580311.816446:0:189456:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15cc:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:2.0:1777580311.816455:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.816457:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.816461:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 43 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.816473:0:189456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 43 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.816481:0:189456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32800, rc 0) 00000100:00100000:2.0:1777580311.816501:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946630784:12345-192.168.202.9@tcp:101:rm.500 Request processed in 118us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.816507:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11856 00010000:00010000:1.0:1777580311.817475:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580311.817489:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817504:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580311.817509:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817521:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817541:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817549:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4a882 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1580:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817576:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580311.817581:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817588:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580311.817591:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817599:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817630:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817638:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4a858 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.817655:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580311.817657:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580311.817659:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.817800:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e47be9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x157c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d94e expref: 23 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.817826:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917460992:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.817863:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.817891:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.817897:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.817908:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.817916:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.817937:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580311.822259:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6b227a/0xcb2b2f2f7e484b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db70 expref: 42 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.822291:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917462400:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.822325:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.822360:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.822368:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.822380:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.822390:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.822466:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580311.823237:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917460736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30519us (33168us total) trans 8589938971 rc 0/0 00000100:00100000:3.0:1777580311.823250:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11849 00010000:00010000:3.0:1777580311.823319:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e48073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1581:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da6d expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.823338:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917461632:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.823359:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.823368:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.823382:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.823391:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.823398:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.824391:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917458944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33535us (34905us total) trans 8589938570 rc 0/0 00000100:00100000:2.0:1777580311.824403:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11838 00010000:00010000:2.0:1777580311.824481:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a161f8e/0xcb2b2f2f7e48088 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x157e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da74 expref: 41 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.824500:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917461120:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.824520:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.824530:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.824546:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.824556:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.824564:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826400:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580311.826420:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826461:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb6800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.826467:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826478:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826505:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826512:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4a82e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x157c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826542:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580311.826547:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826553:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.826556:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826564:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826575:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826588:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4a87b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826615:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580311.826620:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826626:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.826629:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826637:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826647:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826655:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.826658:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826664:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.826667:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826686:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826697:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.826706:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.826708:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.826710:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580311.827280:0:3288:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589938540 gen 2 00000004:00080000:0.0:1777580311.827299:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30f800, transno 8589938489 00000004:00080000:0.0:1777580311.827314:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f800, transno 8589938490 00000004:00080000:0.0:1777580311.827318:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0238e369500, transno 8589938491 00000004:00080000:0.0:1777580311.827321:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ed80, transno 8589938492 00000004:00080000:0.0:1777580311.827324:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30c380, transno 8589938493 00000004:00080000:0.0:1777580311.827327:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985f9500, transno 8589938494 00000004:00080000:0.0:1777580311.827329:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0238e369180, transno 8589938495 00000004:00080000:0.0:1777580311.827332:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f100, transno 8589938496 00000004:00080000:0.0:1777580311.827335:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ad9c4700, transno 8589938497 00000004:00080000:0.0:1777580311.827339:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef33b80, transno 8589938499 00000004:00080000:0.0:1777580311.827342:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393727100, transno 8589938500 00000004:00080000:0.0:1777580311.827345:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ad9c7100, transno 8589938501 00000004:00080000:0.0:1777580311.827347:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393724380, transno 8589938502 00000004:00080000:0.0:1777580311.827350:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ad9c7b80, transno 8589938503 00000004:00080000:0.0:1777580311.827353:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c2300, transno 8589938504 00000004:00080000:0.0:1777580311.827356:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ad9c4000, transno 8589938505 00000004:00080000:0.0:1777580311.827359:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef37100, transno 8589938507 00000004:00080000:0.0:1777580311.827371:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393726680, transno 8589938508 00000004:00080000:0.0:1777580311.827373:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393725f80, transno 8589938509 00000004:00080000:0.0:1777580311.827376:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef37800, transno 8589938510 00000004:00080000:0.0:1777580311.827379:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc43800, transno 8589938511 00000004:00080000:0.0:1777580311.827381:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc42a00, transno 8589938512 00000004:00080000:0.0:1777580311.827384:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc41500, transno 8589938513 00000004:00080000:0.0:1777580311.827387:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde0e00, transno 8589938514 00000004:00080000:0.0:1777580311.827389:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30fb80, transno 8589938515 00000004:00080000:0.0:1777580311.827392:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30df80, transno 8589938516 00000004:00080000:0.0:1777580311.827394:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30ce00, transno 8589938517 00000004:00080000:0.0:1777580311.827397:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef92300, transno 8589938518 00000004:00080000:0.0:1777580311.827399:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef93800, transno 8589938519 00000004:00080000:0.0:1777580311.827402:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef35f80, transno 8589938520 00000004:00080000:0.0:1777580311.827404:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef91500, transno 8589938521 00000004:00080000:0.0:1777580311.827407:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985fb480, transno 8589938522 00000004:00080000:0.0:1777580311.827410:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235ca80, transno 8589938523 00000004:00080000:0.0:1777580311.827412:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef90700, transno 8589938524 00000004:00080000:0.0:1777580311.827415:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0238e36b100, transno 8589938525 00000004:00080000:0.0:1777580311.827418:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235fb80, transno 8589938526 00000004:00080000:0.0:1777580311.827421:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1c000, transno 8589938527 00000004:00080000:0.0:1777580311.827424:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235ea00, transno 8589938528 00000004:00080000:0.0:1777580311.827427:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985fbb80, transno 8589938529 00000100:00100000:0.0:1777580311.827450:0:3288:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa023a095d180 x1863919917458944/t8589938570(8589938570) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580327 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1777580311.827464:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d180/2, rc 0, transno 8589938570 00000100:00100000:0.0:1777580311.827470:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917458944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.827512:0:3290:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589938937 gen 2 00000004:00080000:0.0:1777580311.827517:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e5c00, transno 8589938886 00000004:00080000:0.0:1777580311.827526:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e5880, transno 8589938887 00000004:00080000:0.0:1777580311.827538:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e7800, transno 8589938888 00000004:00080000:0.0:1777580311.827541:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4a80, transno 8589938889 00000004:00080000:0.0:1777580311.827544:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e6300, transno 8589938891 00000004:00080000:0.0:1777580311.827547:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e5180, transno 8589938892 00000004:00080000:0.0:1777580311.827550:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4000, transno 8589938893 00000004:00080000:0.0:1777580311.827552:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e7100, transno 8589938894 00000004:00080000:0.0:1777580311.827555:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393725500, transno 8589938895 00000004:00080000:0.0:1777580311.827558:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393726a00, transno 8589938896 00000004:00080000:0.0:1777580311.827561:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393727480, transno 8589938897 00000004:00080000:0.0:1777580311.827564:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393724e00, transno 8589938898 00000004:00080000:0.0:1777580311.827567:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393724a80, transno 8589938899 00000004:00080000:0.0:1777580311.827570:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393724000, transno 8589938900 00000004:00080000:0.0:1777580311.827572:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393726d80, transno 8589938903 00000004:00080000:0.0:1777580311.827575:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393726300, transno 8589938904 00000004:00080000:0.0:1777580311.827578:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef35880, transno 8589938905 00000004:00080000:0.0:1777580311.827581:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393725c00, transno 8589938906 00000004:00080000:0.0:1777580311.827585:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02397d5df80, transno 8589938907 00000004:00080000:0.0:1777580311.827587:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393727b80, transno 8589938908 00000004:00080000:0.0:1777580311.827590:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef34e00, transno 8589938909 00000004:00080000:0.0:1777580311.827593:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393727800, transno 8589938910 00000004:00080000:0.0:1777580311.827596:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c4000, transno 8589938911 00000004:00080000:0.0:1777580311.827599:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc42300, transno 8589938912 00000004:00080000:0.0:1777580311.827601:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef35180, transno 8589938913 00000004:00080000:0.0:1777580311.827604:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ac337100, transno 8589938914 00000004:00080000:0.0:1777580311.827607:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae4b5c00, transno 8589938915 00000004:00080000:0.0:1777580311.827610:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae685c00, transno 8589938917 00000004:00080000:0.0:1777580311.827613:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae687800, transno 8589938918 00000004:00080000:0.0:1777580311.827616:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde3800, transno 8589938919 00000004:00080000:0.0:1777580311.827618:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae685f80, transno 8589938920 00000004:00080000:0.0:1777580311.827621:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235c380, transno 8589938921 00000004:00080000:0.0:1777580311.827629:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235c000, transno 8589938922 00000004:00080000:0.0:1777580311.827632:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aeebb800, transno 8589938923 00000004:00080000:0.0:1777580311.827635:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aeeb8380, transno 8589938924 00000004:00080000:0.0:1777580311.827638:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235d180, transno 8589938925 00000004:00080000:0.0:1777580311.827640:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235e680, transno 8589938926 00000004:00080000:0.0:1777580311.827644:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ed80, transno 8589938927 00000100:00100000:0.0:1777580311.827658:0:3290:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa023864a2a00 x1863919917460736/t8589938971(8589938971) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580327 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1777580311.827666:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a2a00/2, rc 0, transno 8589938971 00000100:00100000:0.0:1777580311.827670:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917460736:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580311.827700:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a1f80/2, rc 0, transno 8589938970 00000100:00100000:0.0:1777580311.827704:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917460096:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580311.827717:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580311.827732:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095c380/2, rc 0, transno 8589938569 00000100:00100000:0.0:1777580311.827736:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917459328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.827758:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631040 00000100:00100000:0.0:1777580311.827767:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631040 00000100:00100000:0.0:1777580311.827990:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832735533547 time 7832736098575 state 0x0 ref 1 00000100:00100000:0.0:1777580311.828005:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832736198575 time 7832736098575 state 0x1 ref 1 00000100:00100000:0.0:1777580311.828039:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832736198575 time 7832776901430 state 0x0 ref 1 00000100:00100000:0.0:1777580311.828055:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283024:x1863919946631040:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580311.828160:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580311.828190:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4a794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ff expref: 77 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.828227:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a357 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2cb expref: 76 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.828240:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa02427669200) 00010000:00010000:0.0:1777580311.828252:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.828282:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.828959:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777580311.828971:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4a851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1581:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.829231:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.829243:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.829273:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.829280:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.829937:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830069:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830079:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830086:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580311.830680:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1861, 64 off127296 00000004:00080000:0.0:1777580311.830691:0:187631:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7832779555606ns, next at 7833779553160ns, rc = 0 00010000:00010000:0.0:1777580311.830758:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830770:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830779:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830787:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830794:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.830801:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.830995:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580311.831943:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917459584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40170us (42104us total) trans 8589938571 rc 0/0 00000100:00100000:3.0:1777580311.831960:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11843 00010000:00010000:3.0:1777580311.832062:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e47bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d955 expref: 25 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.832083:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917462272:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.832117:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.832130:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.832175:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.832186:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.832194:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.832216:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580311.832702:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917460224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40141us (42670us total) trans 8589938972 rc 0/0 00000100:00100000:3.0:1777580311.832711:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11848 00010000:00010000:3.0:1777580311.832764:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e47c05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x157b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d963 expref: 22 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.832783:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917461504:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.832801:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.833022:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580311.833030:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4a835 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x157e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.833452:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917459456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42361us (43834us total) trans 8589938572 rc 0/0 00000100:00100000:2.0:1777580311.833461:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11839 00000004:00080000:2.0:1777580311.833976:0:187654:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 30 changes, 8 in progress, 6 in flight, 39 done 00000004:00080000:2.0:1777580311.834317:0:187652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 34 changes, 8 in progress, 6 in flight, 38 done 00010000:00010000:2.0:1777580311.834371:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580311.834382:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.834394:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.834400:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.834428:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.834452:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.834460:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000965f1a2/0xcb2b2f2f7e4a874 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.834485:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.834488:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.834490:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.834512:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.834575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580311.834638:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d500/2, rc 0, transno 8589938572 00000100:00100000:2.0:1777580311.834648:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917459456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.834665:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580311.834672:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.834697:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.834731:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917463552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.834757:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.834781:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777580311.834787:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917463424:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580311.834985:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580311.835020:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835028:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835033:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835039:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024813e3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.835051:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835058:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835070:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa024814ca000) 00010000:00010000:0.0:1777580311.835074:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580311.835078:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835085:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4a8ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835113:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835120:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835126:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835147:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.835151:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835157:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835166:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.835169:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.835179:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835186:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4a8ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.835200:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002d20dd2c reply state 00000000a734d7d1 transno 8589950672 ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.835208:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.835303:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283024:x1863919946631040:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7251us (25123us total) trans 8589950672 rc 0/0 00000100:00100000:0.0:1777580311.835314:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19426 00000100:00100000:0.0:1777580311.835323:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832736198575 time 7832776901430 state 0x2 ref 0 00000004:00080000:0.0:1777580311.835385:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095c700/2, rc 0, transno 8589938571 00000100:00100000:0.0:1777580311.835390:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917459584:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580311.835405:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.835410:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835416:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.835419:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835424:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835434:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80a:0x0].0x0 (ffffa024814ca000) 00010000:00010000:0.0:1777580311.835436:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580311.835439:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835450:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a8c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.835465:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.835467:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.835468:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580311.835492:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a0700/2, rc 0, transno 8589938972 00000100:00100000:0.0:1777580311.835505:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917460224:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580311.835517:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580311.836149:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.836182:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.836212:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.836229:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.836254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.836296:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917462656:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.836324:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.836355:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917462784:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.836367:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.836392:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917462912:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.836402:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917463040:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.836578:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.836645:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463168 00000100:00100000:2.0:1777580311.836655:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463168 00000100:00100000:2.0:1777580311.836706:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463296 00000100:00100000:2.0:1777580311.836710:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463296 00000100:00100000:2.0:1777580311.836728:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463552 00000100:00100000:2.0:1777580311.836731:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463552 00000100:00100000:2.0:1777580311.836751:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463424 00000100:00100000:2.0:1777580311.836754:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463424 00000100:00100000:2.0:1777580311.836776:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11857 00000100:00100000:2.0:1777580311.836787:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917463168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580311.836952:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631296 00000100:00100000:1.0:1777580311.836957:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631296 00010000:00010000:1.0:1777580311.836986:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 41 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.837013:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631552 00000100:00100000:1.0:1777580311.837016:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631552 00010000:00010000:1.0:1777580311.837030:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.837048:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631424 00000100:00100000:1.0:1777580311.837051:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631424 00010000:00010000:1.0:1777580311.837065:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 25 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.837078:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631680 00000100:00100000:1.0:1777580311.837088:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631680 00010000:00010000:1.0:1777580311.837103:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 26 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.837119:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4347 00000100:00100000:1.0:1777580311.837126:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946631296:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580311.837162:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.837170:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 41 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.837185:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 41 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.837210:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bcb0d3e/0xcb2b2f2f7e48494 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1583:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db4d expref: 41 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.837229:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.837231:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.837237:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.837249:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.837280:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580311.837339:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2362:x1863919946631296:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 213us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.837358:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4347 00000100:00100000:1.0:1777580311.837380:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4348 00000100:00100000:1.0:1777580311.837387:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946631552:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580311.837396:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.837401:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.837454:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1777580311.837520:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5512 count 1 00010000:00010000:2.0:1777580311.837550:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837565:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837573:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.837574:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.837577:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837611:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837625:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.837640:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917463680:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.837704:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285000 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.837798:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11858 00000100:00100000:2.0:1777580311.837820:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917463296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.837844:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5506 count 1 00010000:00010000:2.0:1777580311.837861:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837874:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837881:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.837883:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.837885:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837905:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.837913:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.837922:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917464064:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.837945:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.837963:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11859 00000100:00100000:2.0:1777580311.837970:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917463552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.837984:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5542 count 1 00010000:00010000:2.0:1777580311.838009:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838020:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838026:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838027:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838029:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838047:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838056:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.838065:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917464192:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.838085:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285600 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.838162:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11860 00000100:00100000:2.0:1777580311.838170:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917463424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.838185:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5540 count 1 00010000:00010000:2.0:1777580311.838196:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838208:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838225:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838226:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838229:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838250:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 42 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838259:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.838268:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917464448:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.838300:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285240 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.838337:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4349 00000100:00100000:2.0:1777580311.838346:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946631424:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.838355:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.838361:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838372:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838389:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e12fb033/0xcb2b2f2f7e47bfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d947 expref: 26 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838417:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838418:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.838423:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838431:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.838453:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.838479:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946631424:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 135us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.838487:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4349 00000100:00100000:2.0:1777580311.838509:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4350 00000100:00100000:2.0:1777580311.838517:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946631680:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.838525:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.838529:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 24 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.838787:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.838795:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.838824:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.838842:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.838864:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580311.839537:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917459072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47916us (49765us total) trans 8589938573 rc 0/0 00000100:00100000:3.0:1777580311.839547:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11842 00010000:00010000:3.0:1777580311.839635:0:205905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4807a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x157f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da7b expref: 39 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.839653:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917462144:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.839679:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.839689:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.839695:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.839704:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.839720:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.839745:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580311.840067:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3290:x1863919917459712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47653us (50072us total) trans 8589938574 rc 0/0 00000100:00100000:3.0:1777580311.840075:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11847 00010000:00010000:3.0:1777580311.840124:0:193009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e47bf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d95c expref: 24 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.840167:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917461376:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.840181:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840191:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840198:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840206:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840214:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840239:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1777580311.840555:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917460480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49111us (50827us total) trans 8589938973 rc 0/0 00000100:00100000:3.0:1777580311.840562:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11841 00010000:00010000:3.0:1777580311.840606:0:206023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e47c0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x157d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d96a expref: 21 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.840620:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917462016:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.840633:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840641:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840647:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840655:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840662:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.840670:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1777580311.840969:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+15:3290:x1863919917459200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48703us (51019us total) trans 8589938575 rc 0/0 00000100:00100000:3.0:1777580311.840976:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11846 00010000:00010000:3.0:1777580311.841016:0:188247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e479b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d8bb expref: 23 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.841030:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917461248:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.841045:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841054:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841060:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841069:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841077:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841086:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1777580311.841402:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917459968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50124us (51735us total) trans 8589938974 rc 0/0 00000100:00100000:3.0:1777580311.841409:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11840 00010000:00010000:3.0:1777580311.841618:0:205908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a14e6b3/0xcb2b2f2f7e47c4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d978 expref: 22 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.841634:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917461888:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.841649:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841657:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841664:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841672:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841679:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.841689:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1777580311.841913:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.841946:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e48096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da90 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.841962:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580311.842011:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946631552:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4625us (5828us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.842019:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4348 00000100:00100000:1.0:1777580311.842083:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946631936 00000100:00100000:1.0:1777580311.842092:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946631936 00000100:00100000:1.0:1777580311.842156:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4167 00000100:00100000:1.0:1777580311.842166:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283020:x1863919946631936:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580311.842507:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+78:283020:x1863919946631936:12345-192.168.202.9@tcp:35:touch.500 Request processed in 342us (6251us total) trans 8589950673 rc 0/0 00000100:00100000:1.0:1777580311.842516:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4167 00000100:00100000:3.0:1777580311.845579:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917460608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53499us (55649us total) trans 8589938975 rc 0/0 00000100:00100000:3.0:1777580311.845594:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11845 00010000:00010000:3.0:1777580311.845648:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1777580311.845659:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845688:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.845694:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845706:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845733:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845740:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4a84a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x157b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845766:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1777580311.845771:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845777:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.845780:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845787:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.845796:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.845980:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.845990:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846001:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846011:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846024:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1777580311.846473:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917459840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51812us (56300us total) trans 8589938576 rc 0/0 00000100:00100000:0.0:1777580311.846483:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11851 00010000:00010000:0.0:1777580311.846511:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580311.846518:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846526:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.846530:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846549:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846561:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846568:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4a843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846590:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580311.846595:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846602:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.846605:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846612:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846622:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846629:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4a866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x157d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846654:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580311.846658:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846664:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.846667:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846676:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846687:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846694:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4a83c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846708:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580311.846712:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846718:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.846721:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846739:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846749:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846756:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4a85f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846771:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.846775:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846780:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.846783:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846791:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846800:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846926:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ac5e05e/0xcb2b2f2f7e4a889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1583:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.846954:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.846955:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.846957:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.846966:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.848027:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.848046:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.848058:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.848067:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.848092:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580311.848644:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917460352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53667us (58422us total) trans 8589938976 rc 0/0 00000100:00100000:0.0:1777580311.848655:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11852 00000100:00100000:0.0:1777580311.848710:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917464320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580311.848757:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777580311.850169:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4a86d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x157f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850206:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580311.850213:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850222:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.850228:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850240:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850265:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850272:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4a890 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.850292:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.850294:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.850297:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.850791:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 21 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.850824:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4855f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db9a expref: 21 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.850871:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.850874:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.850880:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.850891:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.850932:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.850997:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946631680:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 12479us (14763us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.851007:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4350 00000100:00100000:2.0:1777580311.851072:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.851130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580311.851213:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a1880/2, rc 0, transno 8589938974 00000100:00100000:2.0:1777580311.851226:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917459968:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580311.851239:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a0a80/2, rc 0, transno 8589938973 00000100:00100000:2.0:1777580311.851244:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917460480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.851257:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580311.851264:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.851287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580311.851326:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a0000/2, rc 0, transno 8589938576 00000100:00100000:2.0:1777580311.851337:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917459840:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580311.851348:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a1c00/2, rc 0, transno 8589938976 00000100:00100000:2.0:1777580311.851360:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917460352:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580311.851375:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.851393:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917464320 00000100:00100000:2.0:1777580311.851401:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917464320 00000100:00100000:2.0:1777580311.851441:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463808 00000100:00100000:2.0:1777580311.851444:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463808 00000100:00100000:2.0:1777580311.851463:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917463936 00000100:00100000:2.0:1777580311.851465:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917463936 00000100:00100000:2.0:1777580311.851486:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11861 00000100:00100000:2.0:1777580311.851495:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3290:x1863919917464320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.851534:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5541 count 1 00010000:00010000:2.0:1777580311.851563:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851582:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 40 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851590:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.851591:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.851594:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851628:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 40 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851641:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 40 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.851666:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917464576:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.851714:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285300 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.851735:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11862 00000100:00100000:2.0:1777580311.851743:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917463808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.851757:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5508 count 1 00010000:00010000:2.0:1777580311.851774:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851788:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 38 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851795:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.851797:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.851799:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851820:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 38 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.851830:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 38 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.851857:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aeebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917464704:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.851885:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.851980:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11863 00000100:00100000:2.0:1777580311.851988:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917463936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.852001:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5509 count 1 00010000:00010000:2.0:1777580311.852014:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852027:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 38 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852033:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852035:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852037:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852057:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 38 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852068:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 38 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.852078:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917465216:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.852102:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.852211:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aeeb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917464832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.852244:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.852273:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777580311.852280:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917465344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.852314:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.852342:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917464960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.852365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.852386:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580311.852391:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917465088:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.852411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777580311.852445:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852454:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852462:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852468:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024813e3000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.852474:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852482:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852498:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024814ca500) 00010000:00010000:2.0:1777580311.852501:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.852506:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852513:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4a8b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.852553:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917464832 00000100:00100000:2.0:1777580311.852564:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917464832 00000100:00100000:2.0:1777580311.852595:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917465344 00000100:00100000:2.0:1777580311.852598:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917465344 00000100:00100000:2.0:1777580311.852617:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917464960 00000100:00100000:2.0:1777580311.852620:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917464960 00000100:00100000:2.0:1777580311.852633:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917465088 00000100:00100000:2.0:1777580311.852636:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917465088 00000100:00100000:2.0:1777580311.852652:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11864 00000100:00100000:2.0:1777580311.852658:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3291:x1863919917464832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.852674:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5544 count 1 00010000:00010000:2.0:1777580311.852689:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852704:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852712:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852713:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852716:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852739:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852751:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.852761:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917465472:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.852806:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1600 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.852824:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11865 00000100:00100000:2.0:1777580311.852847:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3291:x1863919917465344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.852862:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5510 count 1 00010000:00010000:2.0:1777580311.852876:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852887:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852894:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852895:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.852898:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852916:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.852925:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.852936:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917465600:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.852958:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.852993:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11866 00000100:00100000:2.0:1777580311.853001:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3288:x1863919917464960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.853013:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5546 count 1 00010000:00010000:2.0:1777580311.853034:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853047:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853053:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.853055:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.853057:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853077:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853087:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.853097:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917465728:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.853122:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393edf480 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.853172:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11867 00000100:00100000:2.0:1777580311.853181:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+18:3288:x1863919917465088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.853193:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5549 count 1 00010000:00010000:2.0:1777580311.853205:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853218:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 19 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853235:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.853237:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.853239:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853261:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 19 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853271:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 19 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.853279:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917465856:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.853305:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f000 going to sleep for 11 seconds 00010000:00010000:2.0:1777580311.853341:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853350:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853358:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853365:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.853397:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1777580311.854054:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095fb80/2, rc 0, transno 8589938575 00000100:00100000:0.0:1777580311.854072:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917459200:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580311.854098:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a3480/2, rc 0, transno 8589938574 00000100:00100000:0.0:1777580311.854110:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917459712:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580311.854166:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095ca80/2, rc 0, transno 8589938573 00000100:00100000:0.0:1777580311.854172:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917459072:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580311.854184:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a1180/2, rc 0, transno 8589938975 00000100:00100000:0.0:1777580311.854192:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917460608:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580311.854207:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.854214:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.854226:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.854230:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.854240:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.854261:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.854269:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a0fc22a/0xcb2b2f2f7e4a897 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.854294:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.854296:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.854298:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580311.856187:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.863319:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.863462:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917464064:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.863498:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.863526:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.863685:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632192 00000100:00100000:2.0:1777580311.863694:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632192 00000100:00100000:2.0:1777580311.863738:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832736198575 time 7832776901430 state 0x0 ref 1 00000100:00100000:2.0:1777580311.863751:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832777001430 time 7832776901430 state 0x1 ref 1 00000100:00100000:2.0:1777580311.863777:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832777001430 time 7832812639571 state 0x0 ref 1 00000100:00100000:2.0:1777580311.863789:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283023:x1863919946632192:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:3.0:1777580311.863972:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917463680:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.863996:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865326:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580311.865373:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4a430 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2fc expref: 77 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865406:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4a350 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x809:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2c4 expref: 76 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865418:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02427669b00) 00010000:00010000:2.0:1777580311.865431:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.865466:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865494:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865505:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865526:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865533:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865539:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865700:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865709:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.865716:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580311.866798:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1856, 64 off126976 00000004:00080000:2.0:1777580311.870085:0:205914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7832818946987ns, next at 7833818935369ns, rc = 0 00010000:00010000:2.0:1777580311.870270:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870293:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870328:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870338:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870344:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870350:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870375:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580311.870404:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870410:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870416:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870421:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.870425:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870433:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870446:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02427669a00) 00010000:00010000:2.0:1777580311.870449:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580311.870460:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870467:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4a923 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870490:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870496:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870502:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870507:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.870509:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870514:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870521:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.870524:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.870527:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.870532:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4a915 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580311.870543:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008511060e reply state 00000000c17ef268 transno 8589950674 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.870566:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580311.870690:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283023:x1863919946632192:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6896us (14509us total) trans 8589950674 rc 0/0 00010000:00010000:3.0:1777580311.870697:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1777580311.870701:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19427 00010000:00010000:3.0:1777580311.870705:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.870711:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832777001430 time 7832812639571 state 0x2 ref 0 00010000:00010000:3.0:1777580311.870712:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.870715:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.870721:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.870729:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x809:0x0].0x0 (ffffa02427669a00) 00010000:00010000:3.0:1777580311.870732:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580311.870734:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.870739:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4a92a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.870758:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.870759:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.870761:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.870996:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917464192:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.871025:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.871063:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917465984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.871154:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.871208:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777580311.871216:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024acde3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917466368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.871242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.871273:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917466112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580311.871382:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917465984 00000100:00100000:3.0:1777580311.871390:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917465984 00000100:00100000:3.0:1777580311.871443:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917466368 00000100:00100000:3.0:1777580311.871447:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917466368 00000100:00100000:3.0:1777580311.871472:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11868 00000100:00100000:3.0:1777580311.871480:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+18:3291:x1863919917465984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580311.871525:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5511 count 1 00010000:00010000:3.0:1777580311.871550:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.871570:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 38 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.871579:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.871582:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.871585:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.871586:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632448 00000100:00100000:1.0:1777580311.871591:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632448 00010000:00010000:1.0:1777580311.871614:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.871624:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 39 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.871638:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 39 pid: 189456 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580311.871640:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4351 00000100:00100000:1.0:1777580311.871646:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2364:x1863919946632448:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777580311.871652:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388f83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917466496:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580311.871655:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580311.871660:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.871672:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.871698:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e484a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1582:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db62 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.871711:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.871712:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580311.871718:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.871728:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.871752:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580311.875341:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2364:x1863919946632448:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3678us (12021us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580311.875377:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4351 00000100:00100000:0.0:1777580311.877104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.878715:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.878896:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580311.878916:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024acde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917466240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.878969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.879042:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917466112 00000100:00100000:2.0:1777580311.879052:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917466112 00000100:00100000:2.0:1777580311.879107:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917466240 00000100:00100000:2.0:1777580311.879111:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917466240 00000100:00100000:2.0:1777580311.879163:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11869 00000100:00100000:2.0:1777580311.879174:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3291:x1863919917466368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.879232:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5543 count 1 00010000:00010000:2.0:1777580311.879266:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.879922:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.879933:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.879935:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.879939:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.879985:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 40 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.880000:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.880016:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917466624:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.880103:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.880158:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11870 00000100:00100000:2.0:1777580311.880171:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3288:x1863919917466112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.880192:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5513 count 1 00010000:00010000:2.0:1777580311.880214:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.880243:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 20 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.880251:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.880253:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.880255:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.880278:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 20 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.880923:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 20 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.880938:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917466752:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.880998:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285600 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.881029:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11871 00000100:00100000:2.0:1777580311.881041:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3288:x1863919917466240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.881065:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5514 count 1 00010000:00010000:2.0:1777580311.881083:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881096:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 20 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881117:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.881119:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.881122:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881172:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 20 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881182:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 20 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.881191:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917466880:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.881224:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285000 going to sleep for 11 seconds 00010000:00010000:2.0:1777580311.881247:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881257:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881267:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881276:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.881314:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580311.882275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.882420:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.886296:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02388620b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.893111:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917463296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55291us (58398us total) trans 8589938577 rc 0/0 00000100:00100000:2.0:1777580311.893160:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11858 00010000:00010000:2.0:1777580311.893230:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580311.893241:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893257:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.893262:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893274:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893305:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893314:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4a8cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1582:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893345:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.893347:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.893349:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.893370:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632320 00000100:00100000:2.0:1777580311.893397:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632320 00010000:00010000:2.0:1777580311.893442:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.893475:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632576 00000100:00100000:2.0:1777580311.893478:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632576 00010000:00010000:2.0:1777580311.893493:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 41 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.893510:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632704 00000100:00100000:2.0:1777580311.893513:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632704 00010000:00010000:2.0:1777580311.893526:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 42 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.893542:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4352 00000100:00100000:2.0:1777580311.893551:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2364:x1863919946632320:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.893569:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.893575:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893591:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893610:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4747693/0xcb2b2f2f7e48899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1588:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc0a expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893622:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893631:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893637:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893648:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893683:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.893740:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2364:x1863919946632320:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 190us (16647us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.893748:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4352 00000100:00100000:2.0:1777580311.893763:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4353 00000100:00100000:2.0:1777580311.893769:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2363:x1863919946632576:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.893778:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.893783:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893793:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893817:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4809d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da97 expref: 42 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893829:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893830:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893850:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893873:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893894:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.893916:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2363:x1863919946632576:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 147us (11647us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.893924:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4353 00000100:00100000:2.0:1777580311.893938:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4354 00000100:00100000:2.0:1777580311.893944:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946632704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.893955:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.893960:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 40 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893970:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 40 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893982:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893983:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.893987:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.893994:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894006:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.894030:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946632704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 86us (11610us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.894037:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4354 00010000:00010000:2.0:1777580311.894096:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e48081 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da82 expref: 39 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.894108:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917464448:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.894170:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894182:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894190:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894201:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894209:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.894231:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580311.894815:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+20:3291:x1863919917463424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56643us (58235us total) trans 8589938977 rc 0/0 00000100:00100000:2.0:1777580311.894824:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11860 00000004:00080000:2.0:1777580311.895041:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1e300/2, rc 0, transno 8589938577 00000100:00100000:2.0:1777580311.895055:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580311.895090:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895102:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895111:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895119:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895165:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580311.895516:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917463168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58730us (60940us total) trans 8589938578 rc 0/0 00000100:00100000:2.0:1777580311.895525:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11857 00010000:00010000:2.0:1777580311.895553:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895565:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895573:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895591:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.895610:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580311.898418:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898533:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898577:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898598:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898619:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.898638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580311.901365:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917465472:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.901407:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901452:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917465216:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.901466:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901497:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632832 00000100:00100000:0.0:1777580311.901506:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632832 00010000:00010000:0.0:1777580311.901560:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 39 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901604:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946632960 00000100:00100000:0.0:1777580311.901608:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946632960 00010000:00010000:0.0:1777580311.901624:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 38 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901665:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633088 00000100:00100000:0.0:1777580311.901668:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633088 00010000:00010000:0.0:1777580311.901683:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901695:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633472 00000100:00100000:0.0:1777580311.901697:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633472 00010000:00010000:0.0:1777580311.901711:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901723:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633216 00000100:00100000:0.0:1777580311.901726:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633216 00010000:00010000:0.0:1777580311.901737:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 41 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901747:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633344 00000100:00100000:0.0:1777580311.901749:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633344 00010000:00010000:0.0:1777580311.901762:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 40 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901773:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633600 00000100:00100000:0.0:1777580311.901776:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633600 00010000:00010000:0.0:1777580311.901789:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 20 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.901818:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4355 00000100:00100000:0.0:1777580311.901844:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2363:x1863919946632832:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580311.901867:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.901872:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 41 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.901885:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 41 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.901916:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.901918:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.901924:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.901935:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.901957:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.902155:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917465600:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.902172:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.902222:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917465728:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.902236:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.902264:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917465856:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.902278:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.902306:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4356 00000100:00100000:2.0:1777580311.902316:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946632960:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.902325:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.902330:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.902354:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.902369:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.902370:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.902373:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.902380:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.902394:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580311.902464:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2363:x1863919946632832:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 630us (4060us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.902473:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4355 00000100:00100000:0.0:1777580311.902529:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4357 00000100:00100000:0.0:1777580311.902536:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946633088:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580311.902544:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.902549:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.902571:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.902585:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7c8df61/0xcb2b2f2f7e484a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1585:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db69 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.902598:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.902600:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.902603:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.902610:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.902631:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580311.911591:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.911632:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946633856 00000100:00100000:1.0:1777580311.911644:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946633856 00000100:00100000:3.0:1777580311.911690:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580311.911693:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832777001430 time 7832812639571 state 0x0 ref 1 00000100:00100000:1.0:1777580311.911709:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832812739571 time 7832812639571 state 0x1 ref 1 00000100:00100000:1.0:1777580311.911729:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634112 00000100:00100000:1.0:1777580311.911732:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634112 00000100:00100000:1.0:1777580311.911745:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832686323462 time 7832725452090 state 0x0 ref 1 00000100:00100000:1.0:1777580311.911752:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832725552090 time 7832725452090 state 0x1 ref 1 00000100:00100000:1.0:1777580311.911769:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832725552090 time 7832860629995 state 0x0 ref 1 00000100:00100000:3.0:1777580311.911774:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4358 00000100:00100000:1.0:1777580311.911780:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+305:283040:x1863919946634112:12345-192.168.202.9@tcp:101:touch.500 00000100:00100000:3.0:1777580311.911784:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946633472:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580311.911805:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580311.911817:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.911860:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.911893:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e484be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db85 expref: 40 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.911916:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.911918:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.911924:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.911934:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912007:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580311.912033:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4a94d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e47d expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912273:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912398:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912414:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912449:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912457:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912464:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912550:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4a962 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912560:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4a962 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912568:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4a962 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580311.912579:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x805:0x0]: returning size 0 00010000:00010000:1.0:1777580311.912710:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912718:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912726:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912732:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.912737:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912756:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912768:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580311.912771:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.912776:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912782:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4a954 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912794:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912799:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.912805:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.913003:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946632960:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 10684us (14464us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.913016:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4356 00000100:00100000:2.0:1777580311.913056:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4359 00000100:00100000:2.0:1777580311.913068:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946633216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.913082:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.913089:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913103:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913152:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4849b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db54 expref: 39 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913168:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913170:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913175:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913184:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913218:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.913257:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2363:x1863919946633216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 193us (14658us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.913264:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4359 00000100:00100000:2.0:1777580311.913301:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4360 00000100:00100000:2.0:1777580311.913311:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2363:x1863919946633344:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.913324:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.913330:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913343:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913372:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e48558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1586:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db93 expref: 38 pid: 205900 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913383:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913384:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913387:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913395:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913412:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.913431:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2363:x1863919946633344:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 123us (14812us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.913438:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4360 00000100:00100000:2.0:1777580311.913454:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4361 00000100:00100000:2.0:1777580311.913462:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2363:x1863919946633600:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.913470:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.913476:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 20 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913486:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 20 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913516:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abaeaeac/0xcb2b2f2f7e48892 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc18 expref: 20 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913527:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913528:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.913531:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913539:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913558:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.913578:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2363:x1863919946633600:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 117us (14938us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.913585:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4361 00010000:00010000:2.0:1777580311.913698:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913707:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913711:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913716:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.913720:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913737:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913748:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024acb3ec00) 00010000:00010000:2.0:1777580311.913751:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.913754:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.913760:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4a91c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914123:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580311.914262:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914271:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914417:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024185aaf00) 00010000:00010000:1.0:1777580311.914421:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580311.914426:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914440:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4a95b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914516:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4a94d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e47d expref: 308 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914531:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4a962 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e47d expref: 307 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580311.914538:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:1.0:1777580311.914540:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580311.914543:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6000, rc 0) 00000100:00100000:1.0:1777580311.914590:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:283040:x1863919946634112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2811us (2899us total) trans 8589950675 rc 0/0 00000100:00100000:2.0:1777580311.914645:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832812739571 time 7832862664418 state 0x0 ref 1 00000100:00100000:2.0:1777580311.914665:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283022:x1863919946633856:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580311.914728:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580311.914745:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4a414 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e30a expref: 76 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914763:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4a2f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x808:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2af expref: 75 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914772:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:2.0:1777580311.914779:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.914894:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914909:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914932:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914950:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914957:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.914963:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.915105:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580311.915112:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.915120:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.915127:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.915154:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2363:x1863919946633472:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3354us (16558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580311.915163:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4358 00000040:00080000:2.0:1777580311.916019:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1862, 64 off127360 00010000:00010000:2.0:1777580311.916101:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.916114:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.916125:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.916516:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946633088:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 13974us (17953us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580311.916527:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4357 00010000:00010000:0.0:1777580311.916609:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6137ba4/0xcb2b2f2f7e484c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1584:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db8c expref: 35 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.916628:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aeebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917464704:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.916654:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.916681:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.916688:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.916697:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.916706:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.916727:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1777580311.916964:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.916980:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.916987:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.916995:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1777580311.917022:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917029:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917035:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917041:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.917045:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917054:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917069:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580311.917072:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580311.917077:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917084:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4a97e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917119:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917125:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917130:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917151:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.917154:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917161:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917169:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580311.917172:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.917174:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.917180:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4a970 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.917189:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:2.0:1777580311.917193:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000019be33ae reply state 0000000080ff1c25 transno 8589950676 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.917201:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580311.917227:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.917266:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283022:x1863919946633856:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2606us (5688us total) trans 8589950676 rc 0/0 00000100:00100000:1.0:1777580311.917385:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19429 00000100:00100000:1.0:1777580311.917394:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832725552090 time 7832860629995 state 0x2 ref 0 00000100:00100000:3.0:1777580311.917406:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.917598:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.917756:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388f83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917466496:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.917777:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.918446:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19428 00000100:00100000:2.0:1777580311.918460:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832812739571 time 7832862664418 state 0x2 ref 0 00010000:00010000:2.0:1777580311.918509:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.918521:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.918531:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.918539:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.918552:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1777580311.919715:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917463808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 67969us (68581us total) trans 8589938579 rc 0/0 00000100:00100000:0.0:1777580311.919729:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11862 00010000:00010000:0.0:1777580311.920975:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e480a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90da9e expref: 36 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.921004:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917464576:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.921039:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.921051:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.921073:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.921085:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.921093:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.921108:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1777580311.921668:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1863919917465344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 68834us (69350us total) trans 8589938580 rc 0/0 00000100:00100000:2.0:1777580311.921680:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11865 00010000:00010000:2.0:1777580311.921730:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.921741:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.921750:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.921770:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.921780:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1777580311.922218:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1777580311.922228:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.922236:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc157f320) 00000100:00100000:0.0:1777580311.922318:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3290:x1863919917464320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 70822us (73559us total) trans 8589938979 rc 0/0 00000100:00100000:0.0:1777580311.922327:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11861 00000004:00080000:0.0:1777580311.922395:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1d500/2, rc 0, transno 8589938579 00000100:00100000:0.0:1777580311.922403:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463808:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580311.922416:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1c000/2, rc 0, transno 8589938578 00000100:00100000:0.0:1777580311.922420:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580311.922441:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1777580311.922448:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922456:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.922459:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922480:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922501:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922508:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009453d7de/0xcb2b2f2f7e4a8c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1588:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922540:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1777580311.922545:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922552:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.922554:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922562:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922573:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922581:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a331869/0xcb2b2f2f7e4a8d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922609:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580311.922614:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922621:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.922624:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922633:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922644:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922652:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309d36a2/0xcb2b2f2f7e4a8eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1584:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922667:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580311.922672:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922680:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.922682:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922689:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922710:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x808:0x0].0x0 (ffffa02427669200) 00010000:00010000:0.0:1777580311.922714:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580311.922719:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922725:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4a985 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x808:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922743:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580311.922748:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922755:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.922758:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922766:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922776:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922784:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4a900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1586:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.922797:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580311.924184:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924212:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924231:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924239:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4a8dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924288:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580311.924293:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924301:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.924305:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924333:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924344:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924351:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4a90e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924367:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.924369:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.924372:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580311.924450:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917466880:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.924480:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.924514:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917466752:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.924529:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.924556:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917466624:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.924570:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924604:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924613:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924624:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924631:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.924656:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580311.925656:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3288:x1863919917464960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72651us (73285us total) trans 8589938980 rc 0/0 00000100:00100000:3.0:1777580311.925669:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11866 00010000:00010000:3.0:1777580311.925711:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580311.925719:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925729:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580311.925734:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925743:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925770:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925777:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4a907 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925799:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.925800:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.925802:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.925817:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925825:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925847:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925855:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.925869:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580311.926241:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.926260:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.926264:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.926272:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.926292:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.926299:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4a8e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.933389:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+20:3288:x1863919917465088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80196us (80962us total) trans 8589938981 rc 0/0 00000100:00100000:2.0:1777580311.933405:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11867 00000100:00100000:2.0:1777580311.933470:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634240 00000100:00100000:2.0:1777580311.933481:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634240 00010000:00010000:2.0:1777580311.933526:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 36 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.933571:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634496 00000100:00100000:2.0:1777580311.933575:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634496 00010000:00010000:2.0:1777580311.933594:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 20 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.933616:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634368 00000100:00100000:2.0:1777580311.933620:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634368 00010000:00010000:2.0:1777580311.933639:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 21 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.933651:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634624 00000100:00100000:2.0:1777580311.933654:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634624 00010000:00010000:2.0:1777580311.933667:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 35 pid: 189456 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.933707:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4362 00000100:00100000:2.0:1777580311.933717:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946634240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.933737:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.933744:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 36 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.933755:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 36 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.933783:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7c9976/0xcb2b2f2f7e484b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90db77 expref: 36 pid: 205896 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.934270:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.934274:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.934281:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.935902:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.935972:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.936067:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946634240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 2344us (18871us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.936079:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4362 00000100:00100000:2.0:1777580311.936208:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4363 00000100:00100000:2.0:1777580311.936222:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2361:x1863919946634496:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.936243:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.936252:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936267:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936289:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10661ba/0xcb2b2f2f7e48da1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd53 expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936309:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936311:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936315:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936322:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936343:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.936363:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2361:x1863919946634496:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 145us (19136us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.936370:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4363 00000100:00100000:2.0:1777580311.936390:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4364 00000100:00100000:2.0:1777580311.936397:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2361:x1863919946634368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.936411:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.936418:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 19 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936428:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 19 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936440:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3c5207/0xcb2b2f2f7e48ac2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dcab expref: 19 pid: 188247 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936452:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936453:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936456:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936463:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936482:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.936501:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2361:x1863919946634368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 105us (19094us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.936508:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4364 00000100:00100000:2.0:1777580311.936524:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4365 00000100:00100000:2.0:1777580311.936532:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946634624:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.936540:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.936547:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 35 pid: 189456 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936564:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 35 pid: 189456 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936577:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002322aacb/0xcb2b2f2f7e488a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1587:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc42 expref: 35 pid: 189456 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936589:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936590:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.936593:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936600:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936619:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.936640:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2361:x1863919946634624:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 108us (19042us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.936647:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4365 00010000:00010000:2.0:1777580311.936698:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936709:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936720:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936737:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.936750:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1777580311.941071:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095ed80/2, rc 0, transno 8589938981 00000100:00100000:0.0:1777580311.941110:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917465088:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580311.941127:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f800/2, rc 0, transno 8589938980 00000100:00100000:0.0:1777580311.941132:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917464960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580311.941317:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.941404:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777580311.941455:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aef33b80/2, rc 0, transno 8589938580 00000100:00100000:0.0:1777580311.941464:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917465344:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580311.941477:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1ed80/2, rc 0, transno 8589938977 00000100:00100000:0.0:1777580311.941482:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917463424:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580311.941527:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580311.941538:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941551:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.941557:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941568:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941592:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941600:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4a8f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941627:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.941631:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941638:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.941640:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941649:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941666:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941673:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4a938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.941691:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.941693:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580311.941695:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580311.941759:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.941791:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.941828:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777580311.941844:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.941867:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.941894:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580311.941912:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.942028:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467008 00000100:00100000:0.0:1777580311.942036:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467008 00000100:00100000:0.0:1777580311.942082:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467264 00000100:00100000:0.0:1777580311.942085:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467264 00000100:00100000:0.0:1777580311.942097:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467136 00000100:00100000:0.0:1777580311.942099:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467136 00000100:00100000:0.0:1777580311.942113:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467648 00000100:00100000:0.0:1777580311.942115:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467648 00000100:00100000:0.0:1777580311.942157:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11872 00000100:00100000:0.0:1777580311.942168:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3291:x1863919917467008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580311.942214:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5515 count 1 00010000:00010000:0.0:1777580311.942245:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942269:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942277:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.942280:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.942284:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942317:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942334:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.942348:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917467776:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.942417:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777580311.942458:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580311.942485:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.942507:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580311.942511:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580311.942530:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.942682:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580311.942712:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580311.942741:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467520 00000100:00100000:0.0:1777580311.942746:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467520 00000100:00100000:0.0:1777580311.942766:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467392 00000100:00100000:0.0:1777580311.942768:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467392 00000100:00100000:0.0:1777580311.942778:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917467904 00000100:00100000:0.0:1777580311.942780:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917467904 00000100:00100000:0.0:1777580311.942792:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11873 00000100:00100000:0.0:1777580311.942798:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917467264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580311.942812:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5517 count 1 00010000:00010000:0.0:1777580311.942828:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942855:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942862:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.942864:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.942867:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942890:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942900:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.942911:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917468032:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.942943:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c600 going to sleep for 11 seconds 00010000:00010000:0.0:1777580311.942962:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942972:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942983:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.942992:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943010:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580311.943569:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+25:3288:x1863919917463936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 91580us (92279us total) trans 8589938581 rc 0/0 00000100:00100000:0.0:1777580311.943578:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11863 00000100:00100000:0.0:1777580311.943606:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11874 00000100:00100000:0.0:1777580311.943615:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917467136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580311.943632:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5516 count 1 00010000:00010000:0.0:1777580311.943648:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943663:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943684:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.943686:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580311.943689:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943714:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943725:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.943736:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aeebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917468160:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580311.943770:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11cd80 going to sleep for 11 seconds 00010000:00010000:0.0:1777580311.943788:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580311.943795:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943804:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580311.943808:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.943818:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.946019:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11875 00000100:00100000:2.0:1777580311.946050:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3289:x1863919917467648:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580311.946091:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.946107:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.946120:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.946129:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.946162:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580311.946754:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3288:x1863919917466240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 65714us (67782us total) trans 8589938582 rc 0/0 00000100:00100000:2.0:1777580311.946763:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11871 00000100:00100000:2.0:1777580311.946795:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11876 00000100:00100000:2.0:1777580311.947508:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3291:x1863919917467520:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580311.947553:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.947568:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.947579:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.947588:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.947602:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580311.948164:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3288:x1863919917466112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 67996us (69455us total) trans 8589938583 rc 0/0 00000100:00100000:2.0:1777580311.948175:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11870 00000100:00100000:2.0:1777580311.948204:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11877 00000100:00100000:2.0:1777580311.948214:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3291:x1863919917467392:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.948238:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11878 00000100:00100000:2.0:1777580311.948246:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917467904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.948278:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5518 count 1 00010000:00010000:2.0:1777580311.948306:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948331:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 17 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948349:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.948352:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.948356:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948403:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 17 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948418:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 17 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.948437:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917468288:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.948519:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32480 going to sleep for 11 seconds 00010000:00010000:2.0:1777580311.948557:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580311.948565:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948575:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.948580:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948591:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948614:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948632:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4a946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948660:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580311.948664:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948671:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.948674:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948682:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948693:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948701:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4a93f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948719:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.948722:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.948724:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.948740:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948761:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948770:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.948779:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.953256:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580311.953754:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.953789:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917465984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 82307us (82654us total) trans 8589938584 rc 0/0 00000100:00100000:3.0:1777580311.953804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580311.953910:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580311.954000:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954024:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4a8f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1585:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.954074:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946634880 00000100:00100000:0.0:1777580311.954084:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946634880 00000100:00100000:0.0:1777580311.954155:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832725552090 time 7832860629995 state 0x0 ref 1 00000100:00100000:0.0:1777580311.954170:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832860729995 time 7832860629995 state 0x1 ref 1 00000100:00100000:0.0:1777580311.954192:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635136 00000100:00100000:0.0:1777580311.954195:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635136 00000100:00100000:0.0:1777580311.954207:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832860729995 time 7832860629995 state 0x1 ref 2 00000100:00100000:0.0:1777580311.954222:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635392 00000100:00100000:0.0:1777580311.954224:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635392 00000100:00100000:0.0:1777580311.954235:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832812739571 time 7832862664418 state 0x0 ref 1 00000100:00100000:0.0:1777580311.954242:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832862764418 time 7832862664418 state 0x1 ref 1 00000100:00100000:0.0:1777580311.954262:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832903224102 time 7832903124102 state 0x1 ref 2 00000100:00100000:0.0:1777580311.954275:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+308:283040:x1863919946634880:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580311.954348:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580311.954379:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4a962 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e47d expref: 308 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954395:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:0.0:1777580311.954407:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.954502:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954519:0:187631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 76 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954530:0:187631:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954575:0:187631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 76 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.954588:0:187631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 76 pid: 188495 timeout: 7932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.954605:0:187631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917468416:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.956448:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11868 00010000:00010000:2.0:1777580311.956511:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580311.956523:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956538:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.956543:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956555:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956578:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956603:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4a931 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1587:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956632:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.956634:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.956636:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.956652:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956662:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956668:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956673:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580311.956678:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956684:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956695:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02427669600) 00010000:00010000:2.0:1777580311.956698:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580311.956702:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.956708:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4a977 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580311.956810:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ad9c4000/2, rc 0, transno 8589938584 00000100:00100000:0.0:1777580311.957037:0:187631:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c300 going to sleep for 11 seconds 00000100:00100000:0.0:1777580311.957076:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832862764418 time 7832905934593 state 0x0 ref 1 00000100:00100000:0.0:1777580311.957101:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283012:x1863919946635392:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580311.957191:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580311.957212:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4a3dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2ee expref: 75 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957230:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4a2d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x807:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2a8 expref: 74 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957254:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa02486090600) 00010000:00010000:0.0:1777580311.957266:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580311.957292:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957308:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957320:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957339:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957346:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957352:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957506:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957515:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.957521:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580311.958240:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1857, 64 off127040 00010000:00010000:0.0:1777580311.958313:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958331:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958340:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958348:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958354:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958361:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958880:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580311.958910:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958917:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958924:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958930:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.958935:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958944:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958970:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa024814cae00) 00010000:00010000:0.0:1777580311.958973:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580311.958978:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.958984:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4a9bd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959010:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959017:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959022:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959027:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.959030:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959036:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959043:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.959045:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.959048:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959053:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4a9af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.959074:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c0db9a1e reply state 000000001eddbf64 transno 8589950677 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.959085:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580311.959227:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283012:x1863919946635392:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2131us (5311us total) trans 8589950677 rc 0/0 00000100:00100000:0.0:1777580311.959238:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19432 00000100:00100000:0.0:1777580311.959247:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832862764418 time 7832905934593 state 0x2 ref 0 00000100:00100000:0.0:1777580311.959300:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832903224102 time 7832908161849 state 0x0 ref 2 00000100:00100000:0.0:1777580311.959318:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:283042:x1863919946635136:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580311.959337:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580311.959353:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4a9cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e484 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959487:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959500:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959509:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959526:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959533:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.959549:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580311.965192:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ab:0x0], index 1: 0 00010000:00010000:0.0:1777580311.965614:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a9e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965636:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965650:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965699:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965706:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965713:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965720:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580311.965725:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965733:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965746:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580311.965750:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580311.965763:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.965770:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4a9d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580311.965789:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000739c9014 reply state 000000004a31fe08 transno 8589950678 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.965800:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580311.968079:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4a9cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e484 expref: 310 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.968118:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e484 expref: 309 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580311.968129:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa024814cab00) 00010000:00010000:0.0:1777580311.968148:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580311.968153:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ba00, rc 0) 00000100:00100000:0.0:1777580311.968247:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283042:x1863919946635136:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8933us (14440us total) trans 8589950678 rc 0/0 00000100:00100000:0.0:1777580311.968258:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19431 00000100:00100000:2.0:1777580311.970199:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917465984:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580311.970354:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580311.970365:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970377:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580311.970382:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970393:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970413:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x807:0x0].0x0 (ffffa024814cae00) 00010000:00010000:2.0:1777580311.970417:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580311.970424:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970431:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4a9c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970465:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.970467:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580311.970469:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.970481:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777580311.970503:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917468544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.970594:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.970646:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917468544 00000100:00100000:2.0:1777580311.970654:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917468544 00000100:00100000:2.0:1777580311.970709:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11879 00000100:00100000:2.0:1777580311.970716:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917468544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.970746:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5521 count 1 00010000:00010000:2.0:1777580311.970770:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970792:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 33 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970799:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.970811:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.970815:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970850:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 33 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.970865:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 33 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.970883:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917468672:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.970945:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32cc0 going to sleep for 11 seconds 00002000:00080000:2.0:1777580311.971019:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5548 count 1 00010000:00010000:2.0:1777580311.971037:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971050:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971064:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971065:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971068:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971087:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971098:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 34 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.971109:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917468800:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.971150:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32000 going to sleep for 11 seconds 00002000:00080000:2.0:1777580311.971175:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5547 count 1 00010000:00010000:2.0:1777580311.971189:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971202:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971209:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971211:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971214:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971242:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971251:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.971262:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917468928:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.971291:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32c00 going to sleep for 11 seconds 00002000:00080000:2.0:1777580311.971320:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5550 count 1 00010000:00010000:2.0:1777580311.971331:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971343:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 18 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971350:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971351:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.971353:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971372:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 18 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.971380:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 18 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.971405:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917469056:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.971427:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32540 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.971553:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917464832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 118893us (119307us total) trans 8589938983 rc 0/0 00000100:00100000:2.0:1777580311.971562:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11864 00000100:00100000:2.0:1777580311.971649:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917460864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 176360us (181396us total) trans 8589938984 rc 0/0 00000100:00100000:2.0:1777580311.971656:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11853 00000004:00080000:2.0:1777580311.971710:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aeeb8380/2, rc 0, transno 8589938983 00000100:00100000:2.0:1777580311.971726:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aeeb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917464832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580311.971739:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a3100/2, rc 0, transno 8589938984 00000100:00100000:2.0:1777580311.971743:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917460864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.971811:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917469184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.971849:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.971884:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777580311.971892:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917469312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.971914:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.971938:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917469184 00000100:00100000:2.0:1777580311.971943:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917469184 00000100:00100000:2.0:1777580311.971971:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917469312 00000100:00100000:2.0:1777580311.971973:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917469312 00000100:00100000:2.0:1777580311.971988:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11880 00000100:00100000:2.0:1777580311.971995:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917469184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.972010:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5552 count 1 00010000:00010000:2.0:1777580311.972032:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972047:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972054:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972056:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972059:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972078:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972088:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 18 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.972097:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e368700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917469440:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.972122:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32780 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.972190:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11881 00000100:00100000:2.0:1777580311.972197:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3289:x1863919917469312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.972209:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5551 count 1 00010000:00010000:2.0:1777580311.972222:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972233:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972251:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972253:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972255:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972276:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972285:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 18 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.972294:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e36a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917469568:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.972323:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.972410:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917463552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134440us (137652us total) trans 8589938978 rc 0/0 00000100:00100000:2.0:1777580311.972416:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11859 00000004:00080000:2.0:1777580311.972448:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1f480/2, rc 0, transno 8589938978 00000100:00100000:2.0:1777580311.972457:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917463552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.972492:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917469696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.972517:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.972542:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917469696 00000100:00100000:2.0:1777580311.972546:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917469696 00000100:00100000:2.0:1777580311.972567:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11882 00000100:00100000:2.0:1777580311.972574:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3289:x1863919917469696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.972594:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5553 count 1 00010000:00010000:2.0:1777580311.972606:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972619:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 18 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972626:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972628:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972631:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972650:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 18 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972659:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 18 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.972669:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02483f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917469824:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.972690:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32900 going to sleep for 11 seconds 00000100:00100000:2.0:1777580311.972748:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917466368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 93577us (101505us total) trans 8589938982 rc 0/0 00000100:00100000:2.0:1777580311.972755:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11869 00000004:00080000:2.0:1777580311.972781:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024acde3800/2, rc 0, transno 8589938982 00000100:00100000:2.0:1777580311.972787:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024acde3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917466368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.972815:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777580311.972827:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917469952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.972863:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.972884:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917469952 00000100:00100000:2.0:1777580311.972888:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917469952 00000100:00100000:2.0:1777580311.972906:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11883 00000100:00100000:2.0:1777580311.972912:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917469952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.972924:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5554 count 1 00010000:00010000:2.0:1777580311.972936:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972948:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 18 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972956:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972958:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.972961:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972977:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 18 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.972986:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 18 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.972996:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917470080:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.973013:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32600 going to sleep for 11 seconds 00010000:00010000:3.0:1777580311.974291:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580311.974362:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ac337100/2, rc 0, transno 8589938979 00000100:00100000:3.0:1777580311.974383:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917464320:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1777580311.974419:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.974424:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.974438:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.974790:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917470208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580311.974968:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.975023:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917470208 00000100:00100000:2.0:1777580311.975031:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917470208 00000100:00100000:2.0:1777580311.975077:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11884 00000100:00100000:2.0:1777580311.975087:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3291:x1863919917470208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580311.975117:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5555 count 1 00010000:00010000:2.0:1777580311.975171:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.975198:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 18 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.975207:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.975209:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.975213:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.975244:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 18 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.975256:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 18 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.975269:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917470336:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.975506:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11ca80 going to sleep for 11 seconds 00000004:00080000:3.0:1777580311.975625:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024acde0000/2, rc 0, transno 8589938582 00000100:00100000:3.0:1777580311.975646:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024acde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917466240:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1777580311.975665:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02397d5df80/2, rc 0, transno 8589938583 00000100:00100000:3.0:1777580311.975670:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917466112:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1777580311.975689:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1df80/2, rc 0, transno 8589938581 00000100:00100000:3.0:1777580311.975695:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917463936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580311.975713:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917470464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.975721:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917470592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580311.975766:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777580311.975772:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.975776:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917470720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580311.975823:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917470464 00000100:00100000:3.0:1777580311.975828:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917470464 00000100:00100000:2.0:1777580311.976047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.976074:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580311.976103:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917470720 00000100:00100000:2.0:1777580311.976107:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917470720 00000100:00100000:2.0:1777580311.976127:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917470592 00000100:00100000:2.0:1777580311.976130:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917470592 00000100:00100000:2.0:1777580311.976165:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11885 00000100:00100000:2.0:1777580311.976173:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3291:x1863919917470720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.976192:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5524 count 1 00010000:00010000:2.0:1777580311.976213:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976230:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976238:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.976240:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.976243:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976268:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976281:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 33 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.976291:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11886 00000100:00100000:3.0:1777580311.976299:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3289:x1863919917470592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580311.976313:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5520 count 1 00010000:00010000:3.0:1777580311.976329:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.976331:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917470848:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580311.976346:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 33 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.976352:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.976359:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580311.976362:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580311.976380:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 33 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.976382:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393edf480 going to sleep for 11 seconds 00010000:00010000:3.0:1777580311.976391:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 33 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.976400:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917470976:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.976405:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11887 00000100:00100000:2.0:1777580311.976414:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+28:3288:x1863919917470464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580311.976430:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5519 count 1 00010000:00010000:2.0:1777580311.976442:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976453:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 33 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976461:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976467:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.976468:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.976470:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976492:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 17 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.976502:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.976523:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917471104:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580311.978654:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42600 going to sleep for 11 seconds 00010000:00010000:2.0:1777580311.978692:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 33 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.978715:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.978733:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1671f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917471232:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580311.978778:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1777580311.981814:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.981824:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580311.981829:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580311.985543:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917468288:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580311.985586:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.994083:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917467776:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.994125:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.994192:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917468032:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.994211:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.994271:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aeebb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917468160:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.994286:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580311.994315:0:187631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917468416:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580311.994332:0:187631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580311.994562:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580311.998967:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635904 00000100:00100000:2.0:1777580311.998986:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635904 00010000:00010000:2.0:1777580311.999054:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 18 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580311.999112:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4366 00000100:00100000:2.0:1777580311.999124:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2361:x1863919946635904:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580311.999162:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580311.999169:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 18 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999201:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 18 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999230:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e48fe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dded expref: 18 pid: 206018 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999250:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.999253:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580311.999259:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999270:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999309:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580311.999387:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2361:x1863919946635904:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 265us (4826us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580311.999396:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4366 00010000:00010000:2.0:1777580311.999430:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999440:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999452:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999468:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580311.999485:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580312.000371:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.000560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580312.000901:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000914:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000922:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000929:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.000935:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000944:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000961:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024814ca500) 00010000:00010000:0.0:1777580312.000964:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.000968:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.000986:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4a9d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001025:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001032:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001036:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001041:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.001044:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001050:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001059:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024814ca000) 00010000:00010000:0.0:1777580312.001061:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.001065:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001071:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4a9b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.001100:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635648 00000100:00100000:0.0:1777580312.001110:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635648 00010000:00010000:0.0:1777580312.001208:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.001259:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4367 00000100:00100000:0.0:1777580312.001270:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2364:x1863919946635648:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.001285:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.001292:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001304:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001322:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee5a55a/0xcb2b2f2f7e48eea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddb5 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001337:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.001338:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.001344:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001354:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001386:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.001447:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2364:x1863919946635648:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 178us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.001455:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4367 00010000:00010000:0.0:1777580312.001486:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.001493:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001501:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.001505:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001514:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001525:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001532:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4a9a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001548:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.001551:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.001553:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.001572:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001581:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001591:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001604:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.001620:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580312.002169:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3289:x1863919917467264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 59369us (60376us total) trans 8589938585 rc 0/0 00000100:00100000:0.0:1777580312.002180:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11873 00000004:00080000:0.0:1777580312.002244:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7df9180/2, rc 0, transno 8589938585 00000100:00100000:0.0:1777580312.002259:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580312.002351:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917471360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580312.002393:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777580312.002442:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.002450:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002461:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.002464:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002472:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002487:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002508:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ce233e/0xcb2b2f2f7e4a993 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002526:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.002527:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.002529:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.002542:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917471360 00000100:00100000:0.0:1777580312.002548:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917471360 00000100:00100000:0.0:1777580312.002585:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11888 00000100:00100000:0.0:1777580312.002594:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3291:x1863919917471360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.002624:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5523 count 1 00010000:00010000:0.0:1777580312.002649:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002666:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002674:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.002676:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.002679:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002708:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.002722:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 33 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.002742:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917471488:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.002939:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11c300 going to sleep for 11 seconds 00000100:00100000:2.0:1777580312.005487:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+30:3289:x1863919917467904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57230us (62762us total) trans 8589938586 rc 0/0 00000100:00100000:2.0:1777580312.005503:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11878 00000100:00100000:2.0:1777580312.005593:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917468672:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.005626:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.005667:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917468800:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.005680:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.005705:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636288 00000100:00100000:2.0:1777580312.005712:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636288 00000100:00100000:2.0:1777580312.005770:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832908261849 time 7832908161849 state 0x1 ref 2 00000100:00100000:2.0:1777580312.005789:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832908261849 time 7832954652244 state 0x0 ref 2 00000100:00100000:2.0:1777580312.005816:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+309:283042:x1863919946636288:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580312.005895:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.005926:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4a9e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e484 expref: 309 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.005959:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa024814cab00) 00010000:00010000:2.0:1777580312.005973:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.006067:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.006083:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.006094:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.006281:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008462af8d reply state 00000000388e3203 transno 8589950679 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.006291:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.006396:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283042:x1863919946636288:12345-192.168.202.9@tcp:36:touch.500 Request processed in 596us (5834us total) trans 8589950679 rc 0/0 00000100:00100000:2.0:1777580312.006405:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19433 00000100:00100000:2.0:1777580312.006453:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917468928:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.006468:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.006499:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917469056:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.006512:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777580312.006542:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1777580312.006969:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfb800/2, rc 0, transno 8589938586 00000100:00100000:0.0:1777580312.006995:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.007634:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917471616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.007708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580312.007770:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917471616 00000100:00100000:2.0:1777580312.007777:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917471616 00000100:00100000:2.0:1777580312.009232:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e368700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917469440:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.009269:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.009327:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11889 00000100:00100000:2.0:1777580312.009344:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917471616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580312.009385:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5529 count 1 00010000:00010000:2.0:1777580312.009421:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.009442:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 15 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.009451:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.009454:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.009457:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.009494:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 15 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.009526:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 15 pid: 205897 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.009543:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917471744:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.009619:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f540 going to sleep for 11 seconds 00000100:00100000:2.0:1777580312.011909:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.011942:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.011963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.011987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012039:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012057:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012085:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012101:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012114:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012130:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012206:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.012275:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e36a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917469568:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.012308:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012352:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02483f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917469824:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.012367:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012415:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917470080:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.012429:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012459:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636032 00000100:00100000:2.0:1777580312.012467:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636032 00010000:00010000:2.0:1777580312.012513:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 74 pid: 188495 timeout: 7932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012541:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636544 00000100:00100000:2.0:1777580312.012543:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636544 00010000:00010000:2.0:1777580312.012570:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 35 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012583:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636800 00000100:00100000:2.0:1777580312.012586:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636800 00010000:00010000:2.0:1777580312.012600:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 19 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012612:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637056 00000100:00100000:2.0:1777580312.012615:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637056 00010000:00010000:2.0:1777580312.012626:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 20 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012636:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635520 00000100:00100000:2.0:1777580312.012639:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635520 00010000:00010000:2.0:1777580312.012664:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 16 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012677:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946635776 00000100:00100000:2.0:1777580312.012680:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946635776 00010000:00010000:2.0:1777580312.012692:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012702:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636416 00000100:00100000:2.0:1777580312.012705:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636416 00010000:00010000:2.0:1777580312.012719:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 34 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012728:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636672 00000100:00100000:2.0:1777580312.012730:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636672 00010000:00010000:2.0:1777580312.012740:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 36 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012750:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946636928 00000100:00100000:2.0:1777580312.012752:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946636928 00010000:00010000:2.0:1777580312.012762:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012771:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637184 00000100:00100000:2.0:1777580312.012774:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637184 00010000:00010000:2.0:1777580312.012783:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 22 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012792:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637312 00000100:00100000:2.0:1777580312.012799:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637312 00010000:00010000:2.0:1777580312.012812:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 23 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.012828:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4368 00000100:00100000:2.0:1777580312.013112:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:2364:x1863919946636032:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580312.013131:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.013159:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 74 pid: 188495 timeout: 7932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013173:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 74 pid: 188495 timeout: 7932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013200:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4a44c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e303 expref: 74 pid: 188495 timeout: 7932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013220:0:189815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.013226:0:189815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013237:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013246:0:189815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.013276:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580312.013339:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:2364:x1863919946636032:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 233us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.013394:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4369 00000100:00100000:0.0:1777580312.013407:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2364:x1863919946636544:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.013421:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.013426:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 36 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013437:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 36 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013456:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b59116/0xcb2b2f2f7e488a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc34 expref: 36 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013471:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013473:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013478:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013489:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013530:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.013554:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2364:x1863919946636544:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 152us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.013561:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4369 00000100:00100000:0.0:1777580312.013587:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4370 00000100:00100000:0.0:1777580312.013595:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2364:x1863919946636800:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.013604:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.013609:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 23 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013619:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 23 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013634:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031ece101/0xcb2b2f2f7e48a36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc88 expref: 23 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013645:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013647:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013651:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013659:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013678:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.013703:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2364:x1863919946636800:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 109us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.013711:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4370 00000100:00100000:0.0:1777580312.013727:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4371 00000100:00100000:0.0:1777580312.013733:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2364:x1863919946637056:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.013741:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.013746:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013755:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013768:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5eb5702/0xcb2b2f2f7e48d9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd4c expref: 21 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013778:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013779:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013782:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013789:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013816:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.013847:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2364:x1863919946637056:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 113us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.013853:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4371 00000100:00100000:0.0:1777580312.013876:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4372 00000100:00100000:0.0:1777580312.013884:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2364:x1863919946635520:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.013893:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.013898:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013910:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013925:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d483d609/0xcb2b2f2f7e48daf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd61 expref: 17 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013938:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013940:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.013943:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013951:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.013970:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.013989:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2364:x1863919946635520:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 107us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.013996:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4372 00000100:00100000:0.0:1777580312.014011:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4373 00000100:00100000:0.0:1777580312.014017:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2364:x1863919946635776:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014030:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014035:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 15 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014045:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 15 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014057:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e48ef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ddc3 expref: 15 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014068:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014069:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014072:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014081:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014099:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014120:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946635776:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 103us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014126:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4373 00000100:00100000:0.0:1777580312.014167:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4374 00000100:00100000:0.0:1777580312.014174:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946636416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014183:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014188:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 34 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014203:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 34 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014217:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f759f69a/0xcb2b2f2f7e49588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df83 expref: 34 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014227:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014228:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014231:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014239:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014258:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014278:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946636416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 105us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014285:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4374 00000100:00100000:0.0:1777580312.014298:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4375 00000100:00100000:0.0:1777580312.014305:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946636672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014313:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014318:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014343:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014356:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ecb29c4/0xcb2b2f2f7e488ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dc3b expref: 34 pid: 188246 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014366:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014367:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014371:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014379:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014396:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014412:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946636672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 108us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014418:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4375 00000100:00100000:0.0:1777580312.014432:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4376 00000100:00100000:0.0:1777580312.014439:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2364:x1863919946636928:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014446:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014451:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 19 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014472:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 19 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014484:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e484e6ce/0xcb2b2f2f7e48da8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dd5a expref: 19 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014496:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014498:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014501:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014509:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014526:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014539:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2364:x1863919946636928:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 101us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014546:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4376 00000100:00100000:0.0:1777580312.014583:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4377 00000100:00100000:0.0:1777580312.014589:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2364:x1863919946637184:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014597:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014602:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014624:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014635:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e48ee3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dda7 expref: 17 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014645:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014647:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014651:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014659:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014675:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014687:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2364:x1863919946637184:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 98us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014693:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4377 00000100:00100000:0.0:1777580312.014707:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4378 00000100:00100000:0.0:1777580312.014712:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2362:x1863919946637312:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.014719:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.014724:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 15 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014746:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 15 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014759:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e48fbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dddf expref: 15 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014770:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014771:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.014774:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014783:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.014799:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.014812:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2362:x1863919946637312:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 100us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.014818:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4378 00000100:00100000:0.0:1777580312.014868:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637568 00000100:00100000:0.0:1777580312.014878:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637568 00000100:00100000:0.0:1777580312.014912:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832862764418 time 7832905934593 state 0x0 ref 1 00000100:00100000:0.0:1777580312.014925:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832906034593 time 7832905934593 state 0x1 ref 1 00000100:00100000:0.0:1777580312.014941:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637824 00000100:00100000:0.0:1777580312.014944:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637824 00000100:00100000:0.0:1777580312.014965:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832954752244 time 7832954652244 state 0x1 ref 2 00000100:00100000:0.0:1777580312.014983:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832906034593 time 7832963845459 state 0x0 ref 1 00000100:00100000:0.0:1777580312.014992:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283007:x1863919946637568:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580312.015057:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580312.015076:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4a3f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2f5 expref: 74 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015096:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4a293 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x806:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e293 expref: 73 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015110:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580312.015120:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.015174:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015189:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015198:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015215:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015222:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015228:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015397:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015406:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.015413:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580312.016088:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1863, 64 off127424 00010000:00010000:0.0:1777580312.016206:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016218:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016228:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016234:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016240:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016247:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016274:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580312.016299:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016316:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016323:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016329:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.016334:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016342:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016353:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa024814cad00) 00010000:00010000:0.0:1777580312.016356:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580312.016361:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016368:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4aa65 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016389:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016395:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016401:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016407:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.016416:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016423:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016430:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.016432:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.016435:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016440:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4aa57 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.016449:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000519d73ca reply state 00000000688f0160 transno 8589950680 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.016459:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.016528:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283007:x1863919946637568:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1533us (4393us total) trans 8589950680 rc 0/0 00000100:00100000:0.0:1777580312.016539:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19434 00000100:00100000:0.0:1777580312.016546:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832906034593 time 7832963845459 state 0x2 ref 0 00000100:00100000:0.0:1777580312.016586:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832954752244 time 7832965448383 state 0x0 ref 2 00000100:00100000:0.0:1777580312.016600:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283044:x1863919946637824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580312.016616:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.016626:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aa73 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e48b expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016735:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016745:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016753:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016764:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016772:0:187630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016779:0:187630:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016797:0:187630:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.016807:0:187630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.021730:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.021776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.021819:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.021971:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.021997:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.022476:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.022506:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.022529:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638080 00000100:00100000:3.0:1777580312.022539:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638080 00010000:00010000:3.0:1777580312.022585:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 33 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022630:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638208 00000100:00100000:3.0:1777580312.022632:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638208 00010000:00010000:3.0:1777580312.022644:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 34 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022655:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946637952 00000100:00100000:3.0:1777580312.022657:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946637952 00010000:00010000:3.0:1777580312.022670:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 14 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022680:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638464 00000100:00100000:3.0:1777580312.022682:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638464 00010000:00010000:3.0:1777580312.022693:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 14 pid: 205897 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022704:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638336 00000100:00100000:3.0:1777580312.022706:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638336 00010000:00010000:3.0:1777580312.022716:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 35 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022725:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638720 00000100:00100000:3.0:1777580312.022728:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638720 00010000:00010000:3.0:1777580312.022738:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 36 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.022752:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4379 00000100:00100000:3.0:1777580312.022770:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946638080:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.022788:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.022794:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 36 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.022893:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 36 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023179:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023182:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023188:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023202:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023228:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.023283:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946638080:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 514us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.023293:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4379 00000100:00100000:3.0:1777580312.023320:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4380 00000100:00100000:3.0:1777580312.023328:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946638208:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.023339:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.023344:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 35 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023368:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 35 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023381:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023383:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023386:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023394:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023406:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.023425:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946638208:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 100us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.023432:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4380 00000100:00100000:3.0:1777580312.023448:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4381 00000100:00100000:3.0:1777580312.023454:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2363:x1863919946637952:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.023462:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.023467:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 14 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023476:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 14 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023500:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023502:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023505:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023511:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023522:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.023539:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2363:x1863919946637952:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 85us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.023545:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4381 00000100:00100000:3.0:1777580312.023557:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4382 00000100:00100000:3.0:1777580312.023562:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946638464:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.023569:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.023573:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 14 pid: 205897 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023582:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 14 pid: 205897 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023592:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023594:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.023597:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023614:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023625:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.023642:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946638464:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 79us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.023648:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4382 00000100:00100000:3.0:1777580312.023660:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4383 00000100:00100000:3.0:1777580312.023665:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946638336:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.023672:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.023676:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 34 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023686:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 34 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023699:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.023714:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946638336:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 49us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.023719:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4383 00000100:00100000:3.0:1777580312.023757:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4384 00000100:00100000:3.0:1777580312.023763:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946638720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.023771:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.023782:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 33 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.023792:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 33 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.023965:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4368 00010000:00010000:2.0:1777580312.024069:0:205896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e48fc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90dde6 expref: 13 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.024086:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917470336:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.024111:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.024122:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.024128:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.024155:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.024165:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.024189:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580312.025084:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3291:x1863919917470208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49993us (50110us total) trans 8589938985 rc 0/0 00000100:00100000:2.0:1777580312.025095:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11884 00010000:00010000:2.0:1777580312.025191:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e49263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de87 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.025218:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1671f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917471232:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.025242:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638592 00000100:00100000:2.0:1777580312.025251:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638592 00000100:00100000:2.0:1777580312.025290:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832965548383 time 7832965448383 state 0x1 ref 3 00000100:00100000:2.0:1777580312.025316:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832965548383 time 7832974177719 state 0x0 ref 3 00000100:00100000:2.0:1777580312.025327:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283042:x1863919946638592:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.025350:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.025376:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4aa88 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e492 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025444:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e492 expref: 313 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025460:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e492 expref: 313 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025485:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa02427669600) 00010000:00010000:2.0:1777580312.025489:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580312.025493:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20600, rc 0) 00000100:00100000:2.0:1777580312.025533:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+313:283042:x1863919946638592:12345-192.168.202.9@tcp:101:touch.500 Request processed in 208us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.025540:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19436 00000100:00080000:2.0:1777580312.025656:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777580312.025668:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777580312.025702:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e49503 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1594:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df52 expref: 32 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.025715:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917470848:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.025741:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025751:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025758:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025768:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.025777:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580312.025986:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1671c00/2, rc 0, transno 8589938985 00000100:00100000:0.0:1777580312.026016:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917470208:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580312.026045:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026066:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026075:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026082:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026099:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1777580312.026613:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3289:x1863919917467648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80579us (84698us total) trans 8589938986 rc 0/0 00000100:00100000:0.0:1777580312.026623:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11875 00010000:00010000:0.0:1777580312.026662:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026672:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026681:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026689:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.026709:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1777580312.026997:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3289:x1863919917469312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54799us (55080us total) trans 8589938987 rc 0/0 00000100:00100000:0.0:1777580312.027004:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11881 00010000:00010000:0.0:1777580312.027033:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027044:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027052:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027059:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027068:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1777580312.027363:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917467008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 85196us (85959us total) trans 8589938587 rc 0/0 00000100:00100000:0.0:1777580312.027370:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11872 00010000:00010000:0.0:1777580312.027508:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027518:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027539:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027546:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027555:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1777580312.027789:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917468544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57073us (57195us total) trans 8589938588 rc 0/0 00000100:00100000:0.0:1777580312.027796:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11879 00010000:00010000:0.0:1777580312.027821:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027842:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027851:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027860:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.027868:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:0.0:1777580312.028114:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3291:x1863919917469184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56119us (56264us total) trans 8589938988 rc 0/0 00000100:00100000:0.0:1777580312.028129:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11880 00010000:00010000:0.0:1777580312.028176:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028187:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028196:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028203:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028212:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:0.0:1777580312.028441:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3289:x1863919917469696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55866us (55922us total) trans 8589938989 rc 0/0 00000100:00100000:0.0:1777580312.028447:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11882 00010000:00010000:0.0:1777580312.028471:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028479:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028488:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028505:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028513:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:0.0:1777580312.028732:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3291:x1863919917469952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55820us (55868us total) trans 8589938990 rc 0/0 00000100:00100000:0.0:1777580312.028739:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11883 00010000:00010000:0.0:1777580312.028788:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028795:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028802:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028808:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.028814:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.028823:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029371:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.029376:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.029383:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029397:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029424:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.029479:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2362:x1863919946638720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 5713us (6969us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.029490:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4384 00010000:00010000:3.0:1777580312.029570:0:206018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000262a4562/0xcb2b2f2f7e49255 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de79 expref: 30 pid: 206023 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.029587:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917470976:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.029613:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029624:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029647:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029657:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029664:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.029674:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:2.0:1777580312.029871:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580312.030425:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917470720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54250us (54375us total) trans 8589938589 rc 0/0 00000100:00100000:2.0:1777580312.030436:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11885 00010000:00010000:2.0:1777580312.030498:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032133580/0xcb2b2f2f7e4990f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1599:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e078 expref: 13 pid: 205897 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.030526:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917471744:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.030547:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.030557:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.030563:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.030572:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.030580:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.030589:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:2.0:1777580312.030910:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3288:x1863919917471616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21573us (23201us total) trans 8589938590 rc 0/0 00000100:00100000:2.0:1777580312.030919:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11889 00000004:00080000:2.0:1777580312.030965:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1670a80/2, rc 0, transno 8589938590 00000100:00100000:2.0:1777580312.030981:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917471616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.031335:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580312.031352:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917471872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.031410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777580312.035284:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa02427669600) 00010000:00010000:0.0:1777580312.035295:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.035306:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035320:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4aa49 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035379:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1777580312.035388:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035395:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035399:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035410:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035420:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x806:0x0].0x0 (ffffa024814cad00) 00010000:00010000:0.0:1777580312.035422:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580312.035425:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035432:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4aa6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035456:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1777580312.035462:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035472:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035476:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035484:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035509:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035517:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4aa26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035535:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1777580312.035539:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035546:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035549:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035557:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035567:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035574:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096c5082/0xcb2b2f2f7e4aa2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1594:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035586:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1777580312.035591:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035602:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035605:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035612:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035621:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035627:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4a9f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035641:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1777580312.035645:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035651:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035654:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035661:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035669:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035680:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071849537/0xcb2b2f2f7e4aa11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035695:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1777580312.035699:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035704:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035707:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035716:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035725:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035732:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000328d7596/0xcb2b2f2f7e4a98c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035744:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1777580312.035749:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035755:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035762:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035770:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035779:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035786:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4a9ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035812:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580312.035816:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035822:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035825:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035839:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035848:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035857:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4aa0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035877:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580312.035882:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035889:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035892:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035899:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035908:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035914:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000522c9545/0xcb2b2f2f7e4aa18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035927:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580312.035931:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035937:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035940:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035958:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035967:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035973:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96494ee/0xcb2b2f2f7e4aa1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035985:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580312.035990:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.035996:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.035999:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036006:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036015:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036023:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f011c5eb/0xcb2b2f2f7e4aa34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036051:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.036055:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036062:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.036065:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036073:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036081:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036088:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a63b0fc8/0xcb2b2f2f7e4aa50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1599:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036101:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.036103:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.036104:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580312.036262:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0238e36bb80/2, rc 0, transno 8589938989 00000100:00100000:0.0:1777580312.036276:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917469696:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580312.036289:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0238e369500/2, rc 0, transno 8589938987 00000100:00100000:0.0:1777580312.036292:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917469312:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580312.036303:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfb480/2, rc 0, transno 8589938986 00000100:00100000:0.0:1777580312.036312:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467648:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580312.036349:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1672680/2, rc 0, transno 8589938589 00000100:00100000:0.0:1777580312.036363:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917470720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580312.036374:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1673800/2, rc 0, transno 8589938990 00000100:00100000:0.0:1777580312.036377:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917469952:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580312.036387:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae4b5c00/2, rc 0, transno 8589938988 00000100:00100000:0.0:1777580312.036390:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917469184:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580312.036401:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239235d180/2, rc 0, transno 8589938588 00000100:00100000:0.0:1777580312.036404:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917468544:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580312.036415:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfa680/2, rc 0, transno 8589938587 00000100:00100000:0.0:1777580312.036418:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580312.036423:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580312.036437:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.036500:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.036546:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917471872 00000100:00100000:0.0:1777580312.036553:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917471872 00000100:00100000:0.0:1777580312.036599:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472000 00000100:00100000:0.0:1777580312.036601:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472000 00000100:00100000:0.0:1777580312.036625:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11890 00000100:00100000:0.0:1777580312.036634:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3288:x1863919917471872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.036666:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5522 count 1 00010000:00010000:0.0:1777580312.036689:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036711:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 29 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036726:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.036728:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.036732:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036763:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 29 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036777:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 29 pid: 193009 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.036791:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917472128:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.036869:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285600 going to sleep for 11 seconds 00010000:00010000:0.0:1777580312.036888:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036898:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036904:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036910:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.036914:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036922:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036941:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024814ca600) 00010000:00010000:0.0:1777580312.036945:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.036948:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036958:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036965:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036989:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.036995:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4aa5e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.037091:0:187630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.037099:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580312.037876:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d0:0x0], index 0: 0 00010000:00010000:0.0:1777580312.038103:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4aa96 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038118:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038128:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038213:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038221:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038228:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038234:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.038238:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038245:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038257:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.038260:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.038265:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038271:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aa7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.038289:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c93c5c6d reply state 00000000eb1507c2 transno 8589950681 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.038299:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580312.038348:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aa73 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e48b expref: 313 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038379:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4aa96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e48b expref: 312 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.038387:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa024814cae00) 00010000:00010000:0.0:1777580312.038389:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.038392:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:0.0:1777580312.038468:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+313:283044:x1863919946637824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 21870us (26260us total) trans 8589950681 rc 0/0 00000100:00100000:0.0:1777580312.038480:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19435 00000100:00100000:0.0:1777580312.038541:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.038602:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.038646:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.038670:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.038696:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580312.038702:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.038724:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.038761:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024acde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917472512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.038784:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.038805:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580312.038811:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917472384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580312.041183:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3289:x1863919917470592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 64877us (65099us total) trans 8589938591 rc 0/0 00000100:00100000:3.0:1777580312.041199:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11886 00000100:00100000:3.0:1777580312.041235:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472256 00000100:00100000:3.0:1777580312.041245:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472256 00000100:00100000:3.0:1777580312.041295:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472768 00000100:00100000:3.0:1777580312.041299:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472768 00000100:00100000:3.0:1777580312.041315:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472640 00000100:00100000:3.0:1777580312.041318:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472640 00000100:00100000:3.0:1777580312.041336:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472512 00000100:00100000:3.0:1777580312.041338:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472512 00000100:00100000:3.0:1777580312.041361:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11891 00000100:00100000:3.0:1777580312.041372:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917472000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580312.041410:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5556 count 1 00010000:00010000:3.0:1777580312.041441:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.041486:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 32 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.041495:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.041498:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.041503:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.041549:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 32 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.041564:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 32 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.041583:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917472896:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580312.041653:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777580312.044266:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917471104:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.044313:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.044495:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.044770:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917473280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.044886:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917473024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580312.044932:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11892 00000100:00100000:2.0:1777580312.044952:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917472256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580312.044991:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5565 count 1 00010000:00010000:2.0:1777580312.045365:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045393:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 12 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045402:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.045404:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.045409:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045450:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 12 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045465:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 12 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.045479:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917473408:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.045525:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.045536:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.045547:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.045571:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f540 going to sleep for 11 seconds 00010000:00010000:1.0:1777580312.045578:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.045603:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11893 00010000:00010000:1.0:1777580312.045611:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580312.045614:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917472768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580312.045635:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5557 count 1 00010000:00010000:2.0:1777580312.045649:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045662:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 32 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045668:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.045670:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.045673:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045695:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 32 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.045704:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 32 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.045714:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917473536:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.045742:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1777580312.046240:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3289:x1863919917467136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 102625us (104369us total) trans 8589938592 rc 0/0 00000100:00100000:1.0:1777580312.046250:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11874 00000100:00100000:2.0:1777580312.046271:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.046282:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11894 00000100:00100000:2.0:1777580312.046302:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638848 00000100:00100000:2.0:1777580312.046312:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638848 00000100:00100000:2.0:1777580312.046352:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832906034593 time 7832963845459 state 0x0 ref 1 00000100:00100000:1.0:1777580312.046359:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917472640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580312.046376:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832963945459 time 7832963845459 state 0x1 ref 1 00002000:00080000:1.0:1777580312.046376:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5560 count 1 00010000:00010000:1.0:1777580312.046393:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.046402:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832963945459 time 7832995264356 state 0x0 ref 1 00010000:00010000:1.0:1777580312.046407:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.046411:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283003:x1863919946638848:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580312.046415:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.046417:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.046419:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046431:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.046443:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046449:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4aac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e499 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046453:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 32 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.046471:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917473664:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.046510:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024905089c0 going to sleep for 11 seconds 00010000:00010000:2.0:1777580312.046525:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046530:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046539:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046541:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046549:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046554:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046557:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046571:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.046574:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580312.046577:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046583:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046703:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046713:0:187632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046724:0:187632:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046737:0:187632:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.046747:0:187632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.048453:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580312.049192:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917472384 00000100:00100000:3.0:1777580312.049205:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917472384 00000100:00100000:3.0:1777580312.049283:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11895 00000100:00100000:3.0:1777580312.049297:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3289:x1863919917472512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580312.049364:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5558 count 1 00010000:00010000:3.0:1777580312.049395:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.049423:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.049432:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.049435:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.049439:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.049489:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.049503:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 32 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.049519:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917473792:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.051283:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3291:x1863919917467392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 103061us (108741us total) trans 8589938991 rc 0/0 00000100:00100000:1.0:1777580312.051297:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11877 00000100:00100000:1.0:1777580312.051349:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11896 00000100:00100000:1.0:1777580312.051364:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917472384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580312.051401:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5561 count 1 00010000:00010000:1.0:1777580312.051430:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.051475:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 32 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.051484:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.051487:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.051490:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.051532:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 32 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.051547:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 32 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.051564:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917473920:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.051652:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508540 going to sleep for 11 seconds 00010000:00010000:1.0:1777580312.051690:0:187631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.051698:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.052186:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002ad67a66 reply state 00000000a8519246 transno 8589950682 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.052198:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.052670:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+314:283040:x1863919946634880:12345-192.168.202.9@tcp:36:touch.500 Request processed in 98393us (98919us total) trans 8589950682 rc 0/0 00000100:00100000:1.0:1777580312.052683:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19430 00000100:00100000:1.0:1777580312.052692:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832965548383 time 7832974177719 state 0x2 ref 0 00000004:00080000:2.0:1777580312.053281:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfb100/2, rc 0, transno 8589938991 00000100:00100000:2.0:1777580312.053308:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580312.053397:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917474048:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580312.054186:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580312.054200:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054228:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.054235:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054248:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054278:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054287:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4a99a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054314:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.054319:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054327:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb2800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.054331:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054339:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054352:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054367:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4aa03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054385:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.054387:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.054389:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.054443:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054455:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054468:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054478:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.054495:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580312.056921:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3291:x1863919917467520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 110104us (114420us total) trans 8589938992 rc 0/0 00000100:00100000:0.0:1777580312.056939:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11876 00010000:00010000:0.0:1777580312.057103:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.057116:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057172:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.057177:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057190:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057215:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057223:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4a9fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057250:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057252:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057254:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057263:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057316:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e494fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1593:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df4b expref: 29 pid: 205907 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.057331:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917471488:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580312.057360:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057373:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057388:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057398:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057406:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057436:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580312.057864:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917471360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55269us (55469us total) trans 8589938593 rc 0/0 00000100:00100000:0.0:1777580312.057872:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11888 00010000:00010000:0.0:1777580312.057901:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.057906:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057913:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.057916:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057923:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057936:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057948:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089eff852/0xcb2b2f2f7e4aa42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1593:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.057965:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057967:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057968:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.057980:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580312.058379:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1673480/2, rc 0, transno 8589938591 00000100:00100000:0.0:1777580312.058399:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917470592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580312.058720:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580312.058772:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580312.058810:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580312.061754:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7df9c00/2, rc 0, transno 8589938592 00000100:00100000:0.0:1777580312.061775:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917467136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580312.061820:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946638976 00000100:00100000:0.0:1777580312.061829:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946638976 00010000:00010000:0.0:1777580312.061904:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 13 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.061960:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4385 00000100:00100000:0.0:1777580312.061971:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2362:x1863919946638976:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.061990:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.061996:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 13 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062228:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 13 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062273:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4955e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x158f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df7c expref: 13 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062302:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.062304:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.062309:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062321:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062357:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.062423:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2362:x1863919946638976:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 454us (3652us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.062431:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4385 00010000:00010000:0.0:1777580312.062471:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062482:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062493:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062501:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.062525:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580312.063322:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:3288:x1863919917470464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 86907us (87549us total) trans 8589938594 rc 0/0 00000100:00100000:0.0:1777580312.063334:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11887 00010000:00010000:0.0:1777580312.063368:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.063376:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.063387:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.063393:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.063403:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.063422:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.063429:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018fe56a3/0xcb2b2f2f7e4aa3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.063452:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.063454:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.063456:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.063487:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917473152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580312.063539:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580312.065275:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1777580312.065348:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f100/2, rc 0, transno 8589938593 00000100:00100000:3.0:1777580312.065358:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917471360:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1777580312.065372:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7df8380/2, rc 0, transno 8589938992 00000100:00100000:3.0:1777580312.065382:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917467520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580312.065497:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777580312.065516:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249f2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917474432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580312.065567:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580312.065598:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1777580312.065626:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1672d80/2, rc 0, transno 8589938594 00000100:00100000:3.0:1777580312.065634:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917470464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580312.065643:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917474176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580312.065667:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580312.065684:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777580312.065689:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917474304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580312.065711:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580312.066125:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917472128:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580312.066178:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.066219:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917473152 00000100:00100000:0.0:1777580312.066227:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917473152 00000100:00100000:0.0:1777580312.066273:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917474048 00000100:00100000:0.0:1777580312.066276:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917474048 00000100:00100000:0.0:1777580312.066293:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917474432 00000100:00100000:0.0:1777580312.066296:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917474432 00000100:00100000:0.0:1777580312.066309:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917473024 00000100:00100000:0.0:1777580312.066312:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917473024 00000100:00100000:0.0:1777580312.066327:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917474176 00000100:00100000:0.0:1777580312.066330:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917474176 00000100:00100000:0.0:1777580312.066343:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917474304 00000100:00100000:0.0:1777580312.066346:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917474304 00000100:00100000:0.0:1777580312.066363:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11897 00000100:00100000:0.0:1777580312.066371:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3289:x1863919917473152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.066406:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5526 count 1 00010000:00010000:0.0:1777580312.066436:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066456:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 28 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066466:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.066469:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.066474:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066517:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 28 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066531:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 28 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.066547:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917474560:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.066621:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285600 going to sleep for 11 seconds 00000100:00100000:0.0:1777580312.066642:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11898 00000100:00100000:0.0:1777580312.066649:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3291:x1863919917474048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580312.066665:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5559 count 1 00010000:00010000:0.0:1777580312.066683:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066696:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 32 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066704:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.066705:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.066708:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066729:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 32 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.066751:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 32 pid: 205905 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.066762:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917474688:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.066788:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285240 going to sleep for 11 seconds 00000100:00100000:3.0:1777580312.068353:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917472896:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.068390:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.068788:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917473664:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.068807:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.070115:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11899 00000100:00100000:0.0:1777580312.070155:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3291:x1863919917474432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.070201:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5531 count 1 00010000:00010000:0.0:1777580312.070234:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070258:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 11 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070268:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070270:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070274:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070319:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 11 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070333:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 11 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.070367:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a0416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917474816:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.070476:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777580312.070515:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11900 00000100:00100000:0.0:1777580312.070525:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+36:3288:x1863919917473024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.070541:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5530 count 1 00010000:00010000:0.0:1777580312.070554:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070568:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 11 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070575:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070576:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070579:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070600:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 11 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070610:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 11 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.070622:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a0415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917474944:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.070645:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777580312.070670:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11901 00000100:00100000:0.0:1777580312.070680:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3288:x1863919917474176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.070696:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5527 count 1 00010000:00010000:0.0:1777580312.070711:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070724:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070731:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070733:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.070735:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070758:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.070768:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 28 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.070778:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a0415f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917475072:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.074416:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580312.074612:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917473280 00000100:00100000:2.0:1777580312.074623:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917473280 00000100:00100000:2.0:1777580312.074681:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11902 00000100:00100000:2.0:1777580312.074696:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+37:3288:x1863919917474304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580312.074732:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5528 count 1 00010000:00010000:2.0:1777580312.074767:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.074795:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 28 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.075107:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.075110:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.075115:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.075205:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 28 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.075221:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 28 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.075240:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917475328:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.075342:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f480 going to sleep for 11 seconds 00000100:00100000:2.0:1777580312.075375:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917475200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.075465:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6285300 going to sleep for 11 seconds 00000100:00100000:0.0:1777580312.075515:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11903 00000100:00100000:0.0:1777580312.075530:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3290:x1863919917473280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580312.075551:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5525 count 1 00010000:00010000:0.0:1777580312.075568:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.075601:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 28 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.075609:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.075611:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.075614:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.075640:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 28 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.075650:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 28 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.075660:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917475456:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.075687:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023916233c0 going to sleep for 11 seconds 00010000:00010000:0.0:1777580312.076117:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076129:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076159:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076166:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.076181:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076190:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076212:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024814ca600) 00010000:00010000:0.0:1777580312.076216:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.076222:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.076229:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4aa81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.076991:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.077460:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917473920:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.077493:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.080224:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917475200 00000100:00100000:2.0:1777580312.080240:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917475200 00000100:00100000:2.0:1777580312.080320:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11904 00000100:00100000:2.0:1777580312.080331:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3291:x1863919917475200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580312.080374:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5562 count 1 00010000:00010000:2.0:1777580312.080405:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080434:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 32 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080443:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.080446:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.080449:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080517:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 32 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080531:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 32 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.080549:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388f82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917475584:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580312.080642:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32600 going to sleep for 11 seconds 00010000:00010000:2.0:1777580312.080738:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080748:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080756:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080762:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.080768:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080776:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080796:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.080905:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.080909:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080928:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080935:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080964:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.080971:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4a9a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081102:0:187632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081110:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.081193:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x805:0x0]: returning size 0 00000004:00200000:2.0:1777580312.081199:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.081225:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081239:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081250:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081257:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081277:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081282:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.081284:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081290:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081299:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.081301:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.081304:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081310:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4aac7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081321:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081327:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081333:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081338:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.081341:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081356:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081365:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02427669b00) 00010000:00010000:2.0:1777580312.081367:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.081371:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081377:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4aace lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081425:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4aac0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e499 expref: 74 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081441:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e499 expref: 73 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.081449:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.081451:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.081453:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:2.0:1777580312.081502:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283003:x1863919946638848:12345-192.168.202.9@tcp:101:rm.500 Request processed in 35091us (35231us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.081513:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19437 00000100:00100000:2.0:1777580312.081523:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832963945459 time 7832995264356 state 0x2 ref 0 00000100:00100000:2.0:1777580312.081611:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917473408:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.081637:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.081679:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917473536:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.081694:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.093879:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.093919:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.093942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.093957:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.093976:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.093997:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094124:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094166:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094182:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094199:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094296:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094309:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094340:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094351:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094403:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094416:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094450:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.094494:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639488 00000100:00100000:3.0:1777580312.094504:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639488 00010000:00010000:3.0:1777580312.094553:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094587:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639744 00000100:00100000:3.0:1777580312.094590:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639744 00010000:00010000:3.0:1777580312.094604:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 34 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094616:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639616 00000100:00100000:3.0:1777580312.094619:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639616 00010000:00010000:3.0:1777580312.094632:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 13 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094644:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639872 00000100:00100000:3.0:1777580312.094647:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639872 00010000:00010000:3.0:1777580312.094661:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 35 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094674:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640256 00000100:00100000:3.0:1777580312.094677:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640256 00010000:00010000:3.0:1777580312.094690:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 36 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094713:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639104 00000100:00100000:3.0:1777580312.094716:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639104 00010000:00010000:3.0:1777580312.094734:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 29 pid: 193009 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094746:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640640 00000100:00100000:3.0:1777580312.094749:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640640 00010000:00010000:3.0:1777580312.094761:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 37 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094772:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640896 00000100:00100000:3.0:1777580312.094775:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640896 00010000:00010000:3.0:1777580312.094786:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 38 pid: 205905 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094798:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641280 00000100:00100000:3.0:1777580312.094800:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641280 00010000:00010000:3.0:1777580312.094815:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 30 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094826:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640768 00000100:00100000:3.0:1777580312.094829:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640768 00010000:00010000:3.0:1777580312.094860:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 31 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094873:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641024 00000100:00100000:3.0:1777580312.094881:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641024 00010000:00010000:3.0:1777580312.094899:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 12 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094912:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641152 00000100:00100000:3.0:1777580312.094915:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641152 00010000:00010000:3.0:1777580312.094928:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 13 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094940:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641536 00000100:00100000:3.0:1777580312.094942:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641536 00010000:00010000:3.0:1777580312.094953:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 32 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094962:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641408 00000100:00100000:3.0:1777580312.094964:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641408 00010000:00010000:3.0:1777580312.094973:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 33 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.094988:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4386 00000100:00100000:3.0:1777580312.094998:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2364:x1863919946639488:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777580312.095173:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4387 00000100:00100000:0.0:1777580312.095185:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2364:x1863919946639744:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.095203:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.095211:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 38 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095225:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 38 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095254:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e49549 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df60 expref: 38 pid: 206352 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095274:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095277:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095290:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095301:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095339:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.095406:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2364:x1863919946639744:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 224us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.095414:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4387 00000100:00100000:0.0:1777580312.095437:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4388 00000100:00100000:0.0:1777580312.095444:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2364:x1863919946639616:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.095452:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.095456:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 13 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095466:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 13 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095479:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170cf63d/0xcb2b2f2f7e49891 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e063 expref: 13 pid: 205906 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095490:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095492:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095495:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095517:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095538:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.095558:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2364:x1863919946639616:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 115us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.095565:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4388 00000100:00100000:0.0:1777580312.095579:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4389 00000100:00100000:0.0:1777580312.095585:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2364:x1863919946639872:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.095593:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.095598:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 36 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095609:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 36 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095622:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e49557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df6e expref: 36 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095632:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095633:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095637:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095656:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095686:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.095706:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2364:x1863919946639872:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 121us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.095712:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4389 00000100:00100000:0.0:1777580312.095727:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4390 00000100:00100000:0.0:1777580312.095733:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946640256:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.095741:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.095745:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 34 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095755:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 34 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095766:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f407177f/0xcb2b2f2f7e49542 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df59 expref: 34 pid: 207637 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095775:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095777:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.095780:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.095797:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.095882:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640128 00000100:00100000:2.0:1777580312.095888:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640128 00000100:00100000:2.0:1777580312.095921:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832965548383 time 7832974177719 state 0x0 ref 1 00000100:00100000:2.0:1777580312.095932:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832974277719 time 7832974177719 state 0x1 ref 1 00000100:00100000:2.0:1777580312.095949:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640512 00000100:00100000:2.0:1777580312.095952:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640512 00000100:00100000:2.0:1777580312.095963:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832974277719 time 7832974177719 state 0x1 ref 2 00000100:00100000:2.0:1777580312.095974:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946639360 00000100:00100000:2.0:1777580312.095976:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946639360 00000100:00100000:2.0:1777580312.095985:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832974277719 time 7832974177719 state 0x1 ref 3 00010000:00010000:3.0:1777580312.096127:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096146:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096157:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096183:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4925c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90de80 expref: 33 pid: 205905 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096194:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096196:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096199:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096207:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096229:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096255:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946639488:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1259us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096263:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4386 00010000:00010000:1.0:1777580312.096272:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.096280:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4391 00010000:00010000:1.0:1777580312.096283:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.096287:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2363:x1863919946639104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580312.096296:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096298:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096302:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 33 pid: 193009 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.096305:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096314:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 33 pid: 193009 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096338:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f3f39e5/0xcb2b2f2f7e495ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1592:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df91 expref: 33 pid: 193009 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.096338:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580312.096351:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096352:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096355:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096362:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096381:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096401:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2363:x1863919946639104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 115us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096407:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4391 00000100:00100000:3.0:1777580312.096421:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4392 00000100:00100000:3.0:1777580312.096426:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946640640:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096434:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096438:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 31 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096448:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 31 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096471:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096473:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096476:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096483:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096493:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096511:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946640640:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 85us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096517:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4392 00000100:00100000:3.0:1777580312.096530:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4393 00000100:00100000:3.0:1777580312.096536:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946640896:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096543:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096548:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 30 pid: 205905 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096557:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 30 pid: 205905 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096568:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096569:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096572:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096589:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096600:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096619:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946640896:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096625:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4393 00000100:00100000:3.0:1777580312.096637:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4394 00000100:00100000:3.0:1777580312.096644:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946641280:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096652:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096657:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 31 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096666:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 31 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096678:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096679:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096683:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096690:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096700:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096721:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946641280:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 78us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096728:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4394 00000100:00100000:3.0:1777580312.096740:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4395 00000100:00100000:3.0:1777580312.096746:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946640768:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096756:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096761:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 30 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096770:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 30 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096782:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096783:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096786:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096793:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096803:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096817:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946640768:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 71us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.096823:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4395 00000100:00100000:3.0:1777580312.096852:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4396 00000100:00100000:3.0:1777580312.096859:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2364:x1863919946641024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096875:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096880:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 13 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.096887:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+36:3291:x1863919917472640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50530us (58161us total) trans 8589938993 rc 0/0 00010000:00010000:3.0:1777580312.096891:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 13 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.096896:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11894 00010000:00010000:3.0:1777580312.096904:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096906:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.096909:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.096911:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946640000 00010000:00010000:3.0:1777580312.096916:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.096917:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946640000 00010000:00010000:3.0:1777580312.096927:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.096941:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946641024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 83us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.096944:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11905 00000100:00100000:3.0:1777580312.096947:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4396 00000100:00100000:1.0:1777580312.096950:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946640000:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580312.096959:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4397 00000100:00100000:3.0:1777580312.096965:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2361:x1863919946641152:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.096971:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.096975:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 13 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.096984:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 13 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.097224:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2364:x1863919946640000:12345-192.168.202.9@tcp:2:touch.500 Request processed in 271us (3279us total) trans 8589938595 rc 0/0 00000100:00100000:1.0:1777580312.097232:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11905 00010000:00010000:1.0:1777580312.097258:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.097265:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097274:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.097279:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097289:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097303:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097321:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f232fa36/0xcb2b2f2f7e4aab9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097343:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.097345:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.097347:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580312.097400:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55c2300/2, rc 0, transno 8589938993 00000100:00100000:1.0:1777580312.097419:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.097518:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917475712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.097563:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.097610:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917475712 00000100:00100000:1.0:1777580312.097616:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917475712 00000100:00100000:1.0:1777580312.097644:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11906 00000100:00100000:1.0:1777580312.097651:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3288:x1863919917475712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580312.097667:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5563 count 1 00010000:00010000:1.0:1777580312.097685:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097700:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 29 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097707:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.097709:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.097712:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097748:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 29 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.097761:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 29 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.097773:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917475840:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.097812:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508540 going to sleep for 11 seconds 00010000:00010000:3.0:1777580312.099313:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099320:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099327:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099344:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099371:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.099419:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2361:x1863919946641152:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 2449us (5010us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.099429:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4397 00000100:00100000:3.0:1777580312.099491:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4398 00000100:00100000:3.0:1777580312.099504:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946641536:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.099520:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.099527:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 29 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099540:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 29 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099560:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099562:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099565:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099593:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099607:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.099624:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946641536:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 125us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.099631:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4398 00000100:00100000:3.0:1777580312.099645:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4399 00000100:00100000:3.0:1777580312.099653:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946641408:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.099661:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.099667:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 28 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099679:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 28 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099691:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099693:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.099696:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099705:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.099715:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.099734:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946641408:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (5284us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.099741:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4399 00010000:00010000:0.0:1777580312.099994:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580312.100267:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.100279:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.100300:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.100310:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.100333:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.100379:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100389:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100398:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100405:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100420:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580312.100696:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833049652776 time 7833049552776 state 0x1 ref 3 00000100:00100000:2.0:1777580312.100716:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+314:283040:x1863919946640128:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.100745:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.100765:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4ab29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4a0 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.100873:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3289:x1863919917472384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49514us (62038us total) trans 8589938994 rc 0/0 00000100:00100000:1.0:1777580312.100883:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11896 00010000:00010000:1.0:1777580312.100915:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580312.100922:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100931:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.100935:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.100938:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4ab29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4a0 expref: 315 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100945:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.100962:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030800/0xcb2b2f2f7e4ab29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4a0 expref: 315 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100962:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.100970:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000254db32f/0xcb2b2f2f7e4aaa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.100986:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.100989:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580312.100990:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.100993:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030800, rc 0) 00010000:00010000:1.0:1777580312.100994:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101000:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.101003:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101011:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101032:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101039:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4aae3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101056:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.101058:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.101060:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.101112:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+315:283040:x1863919946640128:12345-192.168.202.9@tcp:101:touch.500 Request processed in 402us (7113us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.101119:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19438 00000100:00100000:2.0:1777580312.101158:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050121366 time 7833050021366 state 0x1 ref 2 00000100:00100000:2.0:1777580312.101169:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+314:283046:x1863919946640512:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.101178:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.101189:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4ab30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4a7 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101367:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101379:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101388:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101406:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101426:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.101433:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.101858:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050121366 time 7833050718716 state 0x0 ref 2 00000100:00100000:1.0:1777580312.101876:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+315:283044:x1863919946639360:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580312.101910:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580312.101928:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4aa96 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e48b expref: 315 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.101943:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa024814cae00) 00010000:00010000:1.0:1777580312.101952:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.101963:0:188248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e49821 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1596:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e032 expref: 27 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.101977:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917474560:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.102019:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.102027:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.102034:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102105:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102116:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102122:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102132:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102157:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.102173:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000095341657 reply state 00000000516e6cd5 transno 8589950683 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.102179:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580312.102180:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.102621:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+316:283044:x1863919946639360:12345-192.168.202.9@tcp:36:touch.500 Request processed in 747us (8417us total) trans 8589950683 rc 0/0 00000100:00100000:1.0:1777580312.102630:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19440 00000004:00080000:1.0:1777580312.102688:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aef92300/2, rc 0, transno 8589938994 00000100:00100000:1.0:1777580312.102703:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917472384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.102785:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1777580312.102790:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ac:0x0], index 1: 0 00000100:00100000:1.0:1777580312.102800:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917475968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580312.103624:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ab4c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103642:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103653:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103695:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103703:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103711:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103717:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.103722:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103728:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103752:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.103755:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.103760:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103768:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4ab37 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.103785:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001eed836e reply state 00000000f0f31769 transno 8589950684 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.103794:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.103857:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4ab30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4a7 expref: 317 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103879:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4a7 expref: 316 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.103887:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa02427669900) 00010000:00010000:2.0:1777580312.103889:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.103892:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148600, rc 0) 00000100:00100000:3.0:1777580312.104261:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+37:3291:x1863919917472000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62888us (67758us total) trans 8589938995 rc 0/0 00000100:00100000:3.0:1777580312.104275:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11891 00010000:00010000:3.0:1777580312.104521:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d18cfc/0xcb2b2f2f7e49550 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df67 expref: 29 pid: 206020 timeout: 7932 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.104536:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917473792:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.104562:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.104591:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.104598:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.104607:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.104615:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.104637:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580312.105185:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3289:x1863919917472512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55891us (66398us total) trans 8589938996 rc 0/0 00000100:00100000:3.0:1777580312.105195:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11895 00000100:00100000:3.0:1777580312.105275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.105398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580312.105475:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae685c00/2, rc 0, transno 8589938995 00000100:00100000:1.0:1777580312.105487:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472000:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580312.105503:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580312.105511:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105522:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.105526:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105534:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105564:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105571:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081fb3c26/0xcb2b2f2f7e4aaea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1596:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105593:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.105597:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105603:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.105606:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105614:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105624:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105630:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4aadc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105645:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.105647:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.105656:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580312.105726:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580312.105741:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917476096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.105779:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.105806:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917475968 00000100:00100000:1.0:1777580312.105814:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917475968 00000100:00100000:1.0:1777580312.105867:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917476096 00000100:00100000:1.0:1777580312.105870:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917476096 00000100:00100000:1.0:1777580312.105889:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11907 00000100:00100000:1.0:1777580312.105902:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+38:3288:x1863919917475968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580312.105930:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5564 count 1 00010000:00010000:1.0:1777580312.105953:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105970:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.105979:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.105982:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.105985:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.106014:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.106028:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 28 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.106054:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917476224:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.106114:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024905089c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580312.106159:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11908 00000100:00100000:1.0:1777580312.106168:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+38:3291:x1863919917476096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580312.106181:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5566 count 1 00010000:00010000:1.0:1777580312.106194:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.106207:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 28 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.106213:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.106215:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.106217:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.106237:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 28 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.108039:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 28 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.108063:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393de8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917476352:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.108176:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024905080c0 going to sleep for 11 seconds 00000004:00080000:1.0:1777580312.108380:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024acde0e00/2, rc 0, transno 8589938996 00000100:00100000:1.0:1777580312.108397:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024acde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917472512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.108480:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917476480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.108525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.108582:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917476480 00000100:00100000:1.0:1777580312.108589:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917476480 00000100:00100000:1.0:1777580312.108637:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11909 00000100:00100000:1.0:1777580312.108647:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3291:x1863919917476480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580312.108676:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5567 count 1 00010000:00010000:1.0:1777580312.108702:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.108722:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 11 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.108731:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.108734:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.108738:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.108766:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 11 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.108779:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 11 pid: 206023 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.108790:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393de8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917476608:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.108828:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508180 going to sleep for 11 seconds 00000100:00100000:2.0:1777580312.109196:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+317:283046:x1863919946640512:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8025us (15009us total) trans 8589950684 rc 0/0 00000100:00100000:2.0:1777580312.109206:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19439 00000100:00100000:2.0:1777580312.109216:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050121366 time 7833050718716 state 0x2 ref 0 00000100:00100000:2.0:1777580312.109247:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641792 00000100:00100000:2.0:1777580312.109252:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641792 00000100:00100000:2.0:1777580312.109280:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832963945459 time 7832995264356 state 0x0 ref 1 00000100:00100000:2.0:1777580312.109301:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832995364356 time 7832995264356 state 0x1 ref 1 00000100:00100000:2.0:1777580312.109323:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832995364356 time 7833058184947 state 0x0 ref 1 00000100:00100000:2.0:1777580312.109333:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283003:x1863919946641792:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.109385:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.109414:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4aad5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e499 expref: 73 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109437:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4a262 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x805:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e285 expref: 72 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109449:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.109455:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.109479:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109493:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109505:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109521:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109529:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109550:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109695:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109705:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.109712:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580312.110745:0:205909:0:(mdd_dir.c:2005:mdd_finish_unlink()) Object [0x200000bd1:0x805:0x0] is inserted into orphan list, open count = 1 00000100:00100000:0.0:1777580312.111160:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3289:x1863919917473152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44783us (47614us total) trans 8589938596 rc 0/0 00000100:00100000:0.0:1777580312.111175:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11897 00010000:00010000:0.0:1777580312.111270:0:205908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4958f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90df8a expref: 28 pid: 205905 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.111292:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917474688:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580312.111327:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.111339:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.111347:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.111358:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.111368:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.111390:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.112195:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112207:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112214:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112221:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.112226:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112235:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112252:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:2.0:1777580312.112256:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.112271:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112278:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ab7d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112297:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112303:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112310:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112315:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.112319:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112326:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112334:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.112336:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.112340:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112345:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ab6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.112356:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000095e46cbb reply state 000000000712bdae transno 8589950685 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.112376:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.112474:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283003:x1863919946641792:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3140us (7198us total) trans 8589950685 rc 0/0 00000100:00100000:2.0:1777580312.112484:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19441 00000100:00100000:2.0:1777580312.112493:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832995364356 time 7833058184947 state 0x2 ref 0 00010000:00010000:2.0:1777580312.112573:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e49d99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1598:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e143 expref: 26 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.112587:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917475328:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.112610:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112621:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112628:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112638:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112645:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.112678:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580312.113193:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+40:3291:x1863919917474048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46542us (47923us total) trans 8589938997 rc 0/0 00000100:00100000:0.0:1777580312.113203:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11898 00010000:00010000:0.0:1777580312.113259:0:205906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e49c3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e112 expref: 12 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.113272:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a0416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917474816:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580312.113525:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113535:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113540:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113549:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113557:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113567:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580312.113751:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3291:x1863919917474432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43624us (48181us total) trans 8589938597 rc 0/0 00000100:00100000:0.0:1777580312.113758:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11899 00010000:00010000:1.0:1777580312.113805:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580312.113814:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113824:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.113828:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113893:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e49a5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e0b0 expref: 11 pid: 193009 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113896:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113917:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.113918:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a0415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917474944:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.113924:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4aaf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113935:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113943:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113944:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580312.113949:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113950:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113956:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.113959:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113960:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113968:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113969:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.113976:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777580312.113985:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.113992:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ab0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1598:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114010:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580312.114013:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114020:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.114022:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114030:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114039:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114046:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4aaf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114057:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.114061:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114073:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.114076:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114084:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114094:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114100:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4aaff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.114114:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.114116:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.114117:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580312.114174:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249f2b8000/2, rc 0, transno 8589938597 00000100:00100000:1.0:1777580312.114189:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249f2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917474432:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580312.114209:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985faa00/2, rc 0, transno 8589938997 00000100:00100000:1.0:1777580312.114219:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917474048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.114592:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917477120:0@lo:400:kworker.0 00000100:00100000:3.0:1777580312.114790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.114949:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946641920 00000100:00100000:3.0:1777580312.114957:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946641920 00010000:00010000:3.0:1777580312.114993:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 28 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.115166:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4400 00000100:00100000:3.0:1777580312.115178:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946641920:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.115203:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.115210:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 28 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.115224:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 28 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.115249:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.115252:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.115258:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.115270:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.115293:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.115340:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946641920:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 165us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.115349:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4400 00000100:00100000:2.0:1777580312.116116:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+39:3288:x1863919917474304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41421us (50399us total) trans 8589938598 rc 0/0 00000100:00100000:2.0:1777580312.116128:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11902 00010000:00010000:2.0:1777580312.116252:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.116298:0:189456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e63b261c/0xcb2b2f2f7e49859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e040 expref: 27 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.116317:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388f82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917475584:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.116344:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.116355:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.116362:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.116374:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.116383:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.116418:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580312.116968:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.116977:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.116988:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.116993:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.117128:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.117167:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.117175:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da2bdc70/0xcb2b2f2f7e4ab1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.117206:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.117208:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.117210:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.117496:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3291:x1863919917475200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37165us (40504us total) trans 8589938998 rc 0/0 00000100:00100000:2.0:1777580312.117507:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11904 00010000:00010000:2.0:1777580312.117540:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.119332:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.119355:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.119369:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.119377:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.119399:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580312.119435:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580312.119526:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985f9500/2, rc 0, transno 8589938998 00000100:00100000:1.0:1777580312.119540:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917475200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.119565:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580312.119579:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917476992:0@lo:400:kworker.0 00000100:00100000:1.0:1777580312.119611:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.119682:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917477120 00000100:00100000:1.0:1777580312.119690:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917477120 00000100:00100000:1.0:1777580312.119754:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917476992 00000100:00100000:1.0:1777580312.119757:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917476992 00000100:00100000:1.0:1777580312.119782:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1777580312.119791:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917477120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580312.119860:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917477120:12345-0@lo:400:kworker.0 Request processed in 69us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.119867:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1777580312.119885:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1777580312.119890:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917476992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580312.119917:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917476992:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.119922:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1777580312.119932:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3288:x1863919917471872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 83299us (88523us total) trans 8589938600 rc 0/0 00000100:00100000:3.0:1777580312.119940:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11890 00000100:00100000:1.0:1777580312.119950:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917476992:0@lo:400:kworker.0 00000100:00100000:1.0:1777580312.119960:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917477120:0@lo:400:kworker.0 00010000:00010000:3.0:1777580312.119982:0:205905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e49828 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1595:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e02b expref: 25 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.119992:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917476864:0@lo:400:kworker.0 00000100:00100000:3.0:1777580312.119997:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917475456:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580312.120019:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580312.120051:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985f9880/2, rc 0, transno 8589938596 00000100:00100000:1.0:1777580312.120060:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917473152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580312.120070:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777580312.120076:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3289:1863919917476736:0@lo:400:kworker.0 00000100:00100000:1.0:1777580312.120116:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580312.120170:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917477248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.120195:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777580312.120215:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777580312.120223:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917477248 00000100:00100000:2.0:1777580312.120227:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917476864 00000100:00100000:1.0:1777580312.120227:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917477248 00000100:00100000:2.0:1777580312.120230:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917476864 00000100:00100000:2.0:1777580312.120253:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1777580312.120261:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917476864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580312.120309:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917476864:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.120315:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1777580312.120347:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917476864:0@lo:400:kworker.0 00010000:00010000:3.0:1777580312.120991:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121021:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121030:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121043:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121053:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121081:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777580312.121514:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11910 00000100:00100000:1.0:1777580312.121527:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+40:3289:x1863919917477248:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580312.121549:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3290:x1863919917473280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46026us (47154us total) trans 8589938601 rc 0/0 00000100:00100000:3.0:1777580312.121557:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11903 00002000:00080000:1.0:1777580312.121558:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5568 count 1 00010000:00010000:1.0:1777580312.121586:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.121607:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.121617:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.121619:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.121623:0:193009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e49860 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1597:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e04e expref: 24 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.121624:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.121638:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a0415f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917475072:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.121656:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.121663:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121664:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121672:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.121677:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121679:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.121687:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.121692:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917477376:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580312.121696:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1777580312.121784:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508480 going to sleep for 11 seconds 00000004:00080000:1.0:1777580312.121845:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a3b80/2, rc 0, transno 8589938598 00000100:00100000:1.0:1777580312.121857:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917474304:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580312.121876:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985fa680/2, rc 0, transno 8589938600 00000100:00100000:1.0:1777580312.121879:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917471872:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580312.121907:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985f8e00/2, rc 0, transno 8589938601 00000100:00100000:1.0:1777580312.121914:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917473280:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580312.122243:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777580312.122253:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122264:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.122268:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122278:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122315:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122323:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8e70007/0xcb2b2f2f7e4aa8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1592:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122345:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580312.122350:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122356:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.122359:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122367:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122376:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122381:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000834f38a7/0xcb2b2f2f7e4ab14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1595:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122393:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.122396:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122408:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.122411:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122418:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122427:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122433:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ab06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1597:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.122445:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.122446:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.122448:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.122976:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3288:x1863919917474176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52292us (57302us total) trans 8589938602 rc 0/0 00000100:00100000:3.0:1777580312.122989:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11901 00010000:00010000:3.0:1777580312.123151:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580312.123466:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a3800/2, rc 0, transno 8589938602 00000100:00100000:1.0:1777580312.123484:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917474176:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1777580312.123542:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.123569:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.123581:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.123590:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.124446:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.125602:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.125616:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.125632:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.125638:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.125650:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.125690:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.125699:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4aaab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.125728:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.125730:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.125731:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.126941:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+38:3288:x1863919917473024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56408us (61332us total) trans 8589938599 rc 0/0 00000100:00100000:0.0:1777580312.126956:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11900 00010000:00010000:0.0:1777580312.127020:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.127047:0:187624:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917476736 00000100:00100000:0.0:1777580312.127058:0:187624:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917476736 00000100:00100000:0.0:1777580312.127105:0:187624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1777580312.127113:0:187624:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3289:x1863919917476736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580312.127214:0:187624:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3289:x1863919917476736:12345-0@lo:400:kworker.0 Request processed in 101us (7096us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.127220:0:187624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1777580312.127292:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3289:1863919917476736:0@lo:400:kworker.0 00000004:00080000:0.0:1777580312.127350:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985fb100/2, rc 0, transno 8589938599 00000100:00100000:0.0:1777580312.127363:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917473024:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580312.127381:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.129589:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+41:3291:x1863919917472256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 84635us (90976us total) trans 8589938999 rc 0/0 00000100:00100000:3.0:1777580312.129603:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11892 00000004:00080000:0.0:1777580312.130035:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aef93800/2, rc 0, transno 8589938999 00000100:00100000:0.0:1777580312.130053:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580312.130086:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130098:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130107:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130114:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.130120:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130129:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130163:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:0.0:1777580312.130167:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.130172:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.130192:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ab45 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.131235:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.131276:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.131300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.132765:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642432 00000100:00100000:0.0:1777580312.132781:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642432 00000100:00100000:0.0:1777580312.132889:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4168 00000100:00100000:0.0:1777580312.132901:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+316:283042:x1863919946642432:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580312.133400:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+317:283042:x1863919946642432:12345-192.168.202.9@tcp:35:touch.500 Request processed in 500us (2171us total) trans 8589950686 rc 0/0 00000100:00100000:0.0:1777580312.133409:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4168 00000100:00100000:0.0:1777580312.133447:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642176 00000100:00100000:0.0:1777580312.133452:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642176 00010000:00010000:0.0:1777580312.133476:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 27 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.133509:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4401 00000100:00100000:0.0:1777580312.133516:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946642176:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.133527:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.133533:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 27 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.133545:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 27 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.133574:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.133589:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.133595:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.133606:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.133630:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.133651:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946642176:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 135us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.133658:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4401 00010000:00010000:1.0:1777580312.141787:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea6c0882/0xcb2b2f2f7e49852 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e039 expref: 26 pid: 205895 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.141818:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917475840:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.141863:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.141876:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.141884:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.141896:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.141923:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.141950:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580312.142697:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3288:x1863919917475712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45042us (45129us total) trans 8589939000 rc 0/0 00000100:00100000:1.0:1777580312.142709:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11906 00000100:00100000:3.0:1777580312.143152:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.143362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.143384:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.143417:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642688 00000100:00100000:3.0:1777580312.143426:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642688 00010000:00010000:3.0:1777580312.143467:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 26 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.143500:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642944 00000100:00100000:3.0:1777580312.143513:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642944 00010000:00010000:3.0:1777580312.143530:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 12 pid: 206023 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.143551:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4402 00000100:00100000:3.0:1777580312.143561:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946642688:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.143577:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.143583:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 26 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143599:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 26 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143631:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.143634:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.143640:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143651:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143676:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.143721:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946642688:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 162us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.143729:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4402 00000100:00100000:3.0:1777580312.143747:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4403 00000100:00100000:3.0:1777580312.143754:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2364:x1863919946642944:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580312.143769:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.143774:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 12 pid: 206023 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143784:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 12 pid: 206023 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143798:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.143799:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.143803:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143811:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.143825:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.143869:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2364:x1863919946642944:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.143877:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4403 00000100:00100000:3.0:1777580312.143930:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580312.143990:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.144001:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.144012:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.144027:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.144049:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580312.144591:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3291:x1863919917472768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 98978us (105917us total) trans 8589939001 rc 0/0 00000100:00100000:3.0:1777580312.144601:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11893 00000100:00100000:2.0:1777580312.146219:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642560 00000100:00100000:2.0:1777580312.146235:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642560 00000100:00100000:2.0:1777580312.146306:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050121366 time 7833050718716 state 0x0 ref 1 00000100:00100000:2.0:1777580312.146322:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050818716 time 7833050718716 state 0x1 ref 1 00000100:00100000:2.0:1777580312.146357:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050818716 time 7833095218384 state 0x0 ref 1 00000100:00100000:2.0:1777580312.146375:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+317:283044:x1863919946642560:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.146408:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.146442:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4ab8b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4ae expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146524:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4ab8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ae expref: 318 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146542:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4ab8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ae expref: 318 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146580:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580312.146584:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580312.146588:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149000, rc 0) 00000100:00100000:2.0:1777580312.146672:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283044:x1863919946642560:12345-192.168.202.9@tcp:101:touch.500 Request processed in 304us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.146679:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19442 00000100:00100000:2.0:1777580312.146685:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050818716 time 7833095218384 state 0x2 ref 0 00010000:00010000:2.0:1777580312.146748:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146757:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146765:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146772:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.146778:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146788:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146815:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02427669b00) 00010000:00010000:2.0:1777580312.146819:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.146823:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146852:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ab3e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146887:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580312.146895:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146905:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.146909:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146917:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146933:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146941:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ab22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146959:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.146964:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146970:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.146973:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.146988:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147750:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147763:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147770:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147775:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.147779:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147785:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147796:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02427669d00) 00010000:00010000:0.0:1777580312.147812:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.147816:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.147846:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ab76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580312.147937:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55fbb80/2, rc 0, transno 8589939001 00000100:00100000:0.0:1777580312.147956:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917472768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580312.147997:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642816 00000100:00100000:0.0:1777580312.148328:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642816 00010000:00010000:0.0:1777580312.148371:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 26 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.148411:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4404 00000100:00100000:0.0:1777580312.148420:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946642816:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.148436:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.148441:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 26 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.148455:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 26 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.148479:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.148481:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.148487:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.148498:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.148534:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.148595:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946642816:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 176us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.148604:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4404 00000004:00080000:0.0:1777580312.148707:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aec3c700/2, rc 0, transno 8589939000 00000100:00100000:0.0:1777580312.148719:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917475712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580312.150487:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946642048 00000100:00100000:1.0:1777580312.150503:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946642048 00000100:00100000:1.0:1777580312.150569:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11911 00000100:00100000:1.0:1777580312.150580:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2361:x1863919946642048:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:1.0:1777580312.150905:0:205895:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x15a1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777580312.150909:0:205895:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x15a1:0x0] updating lvb mtime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.150913:0:205895:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x15a1:0x0] updating lvb atime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.150915:0:205895:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x15a1:0x0] updating lvb ctime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.150918:0:205895:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x15a1:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1777580312.150993:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2361:x1863919946642048:12345-192.168.202.9@tcp:2:touch.500 Request processed in 415us (19690us total) trans 8589938603 rc 0/0 00000100:00100000:1.0:1777580312.151001:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11911 00010000:00010000:1.0:1777580312.151068:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e49867 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e055 expref: 25 pid: 205897 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.151088:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917476224:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.151114:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.151177:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.151185:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.151196:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.151205:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152068:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152089:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4aab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152124:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.152129:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152154:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.152160:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152169:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152193:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.152201:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.152203:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.152826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.152956:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.153011:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.153036:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.153066:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946643328 00000100:00100000:3.0:1777580312.153073:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946643328 00010000:00010000:3.0:1777580312.153113:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 12 pid: 188246 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156276:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777580312.156298:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4ab5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156398:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.156447:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946643200 00000100:00100000:2.0:1777580312.156461:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946643200 00000100:00100000:2.0:1777580312.156510:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7832995364356 time 7833058184947 state 0x0 ref 1 00000100:00100000:2.0:1777580312.156524:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833058284947 time 7833058184947 state 0x1 ref 1 00000100:00100000:2.0:1777580312.156548:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946643584 00000100:00100000:2.0:1777580312.156553:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946643584 00000100:00100000:2.0:1777580312.156564:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833050818716 time 7833095218384 state 0x0 ref 1 00000100:00100000:2.0:1777580312.156571:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833095318384 time 7833095218384 state 0x1 ref 1 00000100:00100000:2.0:1777580312.156584:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946643840 00000100:00100000:2.0:1777580312.156586:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946643840 00000100:00100000:2.0:1777580312.156598:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833095318384 time 7833095218384 state 0x1 ref 2 00000100:00100000:2.0:1777580312.156618:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833058284947 time 7833105480458 state 0x0 ref 1 00000100:00100000:2.0:1777580312.156635:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283025:x1863919946643200:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.156714:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.156745:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4a4bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e342 expref: 72 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.156750:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+41:3288:x1863919917475968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50851us (51351us total) trans 8589939002 rc 0/0 00000100:00100000:1.0:1777580312.156760:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11907 00010000:00010000:2.0:1777580312.156764:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4a388 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2d9 expref: 71 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156776:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02486090900) 00010000:00010000:2.0:1777580312.156788:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.156827:0:207637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7982dd9/0xcb2b2f2f7e49e64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e1b3 expref: 24 pid: 205900 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156842:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.156851:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393de8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917476352:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580312.156873:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156878:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156883:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156895:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156900:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156902:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156907:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156912:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.156913:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156921:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.156938:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580312.157072:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+41:3291:x1863919917476096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50905us (51291us total) trans 8589939003 rc 0/0 00000100:00100000:1.0:1777580312.157079:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11908 00010000:00010000:1.0:1777580312.157115:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ab534da/0xcb2b2f2f7e49dfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e182 expref: 12 pid: 206023 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.157127:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393de8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917476608:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.157140:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157184:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157199:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157207:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157215:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157229:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580312.157242:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.157251:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.157259:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.157348:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3291:x1863919917476480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48703us (48824us total) trans 8589939004 rc 0/0 00000100:00100000:1.0:1777580312.157355:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11909 00000100:00100000:1.0:1777580312.157390:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106351404 time 7833106251404 state 0x1 ref 2 00000100:00100000:1.0:1777580312.157404:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283046:x1863919946643584:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580312.157442:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580312.157457:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ab4c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4a7 expref: 318 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157468:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa02427669900) 00010000:00010000:1.0:1777580312.157476:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.157547:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157567:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157574:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.157690:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000506c94bc reply state 000000005248739b transno 8589950687 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.157699:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.157792:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+319:283046:x1863919946643584:12345-192.168.202.9@tcp:36:touch.500 Request processed in 391us (4779us total) trans 8589950687 rc 0/0 00000100:00100000:1.0:1777580312.157800:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19444 00000100:00100000:1.0:1777580312.157822:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106351404 time 7833106685329 state 0x0 ref 1 00000100:00100000:1.0:1777580312.157845:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283048:x1863919946643840:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.157856:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.157866:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4abae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4b5 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157951:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157962:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.157970:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158000:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158008:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158015:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580312.158584:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d1:0x0], index 0: 0 00010000:00010000:1.0:1777580312.158760:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4abc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158771:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158780:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158817:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158826:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158845:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158852:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.158857:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158877:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158890:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.158893:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.158898:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158904:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4abb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.158919:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e125fcbb reply state 000000001dedb16c transno 8589950688 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.158927:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580312.158963:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4abae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4b5 expref: 321 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158979:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4abc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4b5 expref: 320 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.158986:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa024185aa000) 00010000:00010000:1.0:1777580312.158989:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580312.158991:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b638e400, rc 0) 00000100:00100000:1.0:1777580312.159056:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283048:x1863919946643840:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1225us (6018us total) trans 8589950688 rc 0/0 00000100:00100000:1.0:1777580312.159066:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19445 00000100:00100000:1.0:1777580312.159073:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106351404 time 7833106685329 state 0x2 ref 0 00000100:00100000:1.0:1777580312.159183:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917477376:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580312.159210:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580312.159259:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02393dea300/2, rc 0, transno 8589939004 00000100:00100000:1.0:1777580312.159280:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917476480:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580312.159292:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aec3b480/2, rc 0, transno 8589939003 00000100:00100000:1.0:1777580312.159296:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917476096:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580312.159316:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580312.159323:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159331:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.159334:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159342:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159358:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159366:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006883118f/0xcb2b2f2f7e4ab61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159399:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.159404:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159411:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.159414:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159422:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159433:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159440:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ab68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.159453:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.159455:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.159457:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.159473:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580312.159494:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aec3f100/2, rc 0, transno 8589939002 00000100:00100000:1.0:1777580312.159503:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917475968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580312.159519:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777580312.160315:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1858, 64 off127104 00010000:00010000:2.0:1777580312.160419:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160435:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160447:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160463:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160471:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160477:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160496:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.160518:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160524:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160529:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160534:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.160538:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160544:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160555:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02484c59100) 00010000:00010000:2.0:1777580312.160558:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.160561:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160578:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4aba0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160599:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160604:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160610:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160614:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.160617:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160622:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160629:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.160631:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.160634:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.160639:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ab92 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.160649:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000063026c06 reply state 000000000190a5d0 transno 8589950689 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.160657:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.160751:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283025:x1863919946643200:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4120us (7927us total) trans 8589950689 rc 0/0 00000100:00100000:2.0:1777580312.160760:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19443 00000100:00100000:2.0:1777580312.160768:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833058284947 time 7833105480458 state 0x2 ref 0 00000100:00100000:2.0:1777580312.161049:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2364:x1863919946640256:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 65313us (66923us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.161059:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4390 00000100:00100000:2.0:1777580312.161128:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4405 00000100:00100000:2.0:1777580312.161175:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2364:x1863919946643328:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580312.161192:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.161200:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.161214:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.161234:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e49e25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e190 expref: 11 pid: 188246 timeout: 7933 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.161250:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.161253:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.161258:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.161268:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.161310:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580312.161333:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2364:x1863919946643328:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 165us (8377us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.161339:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4405 00010000:00010000:1.0:1777580312.162500:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.162525:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162536:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.162540:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162550:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162566:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80b:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580312.162569:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.162574:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162580:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4abd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162605:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.162607:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.162609:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.162627:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162638:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162649:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162657:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.162682:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580312.162978:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.162985:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.162994:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.163006:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.163015:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.163029:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.163036:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ab84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.163057:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.163059:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.163067:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580312.163375:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+41:3289:x1863919917477248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41848us (43173us total) trans 8589939005 rc 0/0 00000100:00100000:1.0:1777580312.163385:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11910 00000004:00080000:0.0:1777580312.163400:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249c30dc00/2, rc 0, transno 8589939005 00010000:00010000:1.0:1777580312.163417:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.163418:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917477248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580312.173401:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.181487:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.181630:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.181653:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.181747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580312.182222:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182238:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182247:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182253:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.182259:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182268:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182290:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02427669a00) 00010000:00010000:2.0:1777580312.182294:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.182299:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182306:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ab99 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182343:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182362:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182368:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182374:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.182377:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182383:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182392:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa024185aa400) 00010000:00010000:2.0:1777580312.182395:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.182398:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182404:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4aba7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.182444:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644608 00000100:00100000:2.0:1777580312.182457:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644608 00000100:00100000:2.0:1777580312.182502:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833058284947 time 7833105480458 state 0x0 ref 1 00000100:00100000:2.0:1777580312.182515:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833105580458 time 7833105480458 state 0x1 ref 1 00000100:00100000:2.0:1777580312.182534:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644480 00000100:00100000:2.0:1777580312.182537:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644480 00000100:00100000:2.0:1777580312.182548:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106351404 time 7833106685329 state 0x0 ref 1 00000100:00100000:2.0:1777580312.182566:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106785329 time 7833106685329 state 0x1 ref 1 00000100:00100000:2.0:1777580312.182580:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644736 00000100:00100000:2.0:1777580312.182584:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644736 00000100:00100000:2.0:1777580312.182598:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833105580458 time 7833105480458 state 0x1 ref 2 00000100:00100000:2.0:1777580312.182618:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833131580049 time 7833131480049 state 0x1 ref 2 00000100:00100000:2.0:1777580312.182634:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283050:x1863919946644608:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.182666:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.182686:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4abd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4bc expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182773:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182787:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182903:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182925:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182933:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.182941:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183238:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183248:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183255:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.183291:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e6:0x0]: returning size 0 00000004:00200000:2.0:1777580312.183296:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.183321:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183335:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183344:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183350:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183356:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183362:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.183365:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183372:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183389:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.183392:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.183396:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183401:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4abdf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183415:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183422:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183428:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183434:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.183437:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183444:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183452:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02484c59e00) 00010000:00010000:2.0:1777580312.183454:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.183457:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183464:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4abe6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183516:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4abd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4bc expref: 323 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183532:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4bc expref: 322 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183540:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa02427669600) 00010000:00010000:2.0:1777580312.183542:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.183545:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00000100:00100000:2.0:1777580312.183627:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+322:283050:x1863919946644608:12345-192.168.202.9@tcp:101:rm.500 Request processed in 998us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.183638:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19446 00000100:00100000:2.0:1777580312.183672:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106785329 time 7833132533427 state 0x0 ref 1 00000100:00100000:2.0:1777580312.183686:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283048:x1863919946644480:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580312.183727:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.183744:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4abc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4b5 expref: 321 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.183755:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa024185aa000) 00010000:00010000:2.0:1777580312.183763:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.184221:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833131580049 time 7833133081472 state 0x0 ref 1 00000100:00100000:3.0:1777580312.184237:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283036:x1863919946644736:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.184253:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.184276:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4abf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4c3 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184326:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184337:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184347:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184361:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184368:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184374:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184467:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184477:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184483:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580312.184509:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x816:0x0]: returning size 0 00000004:00200000:3.0:1777580312.184512:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580312.184526:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184543:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184551:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184557:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184563:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184569:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.184573:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184581:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184591:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.184594:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.184597:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184602:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4abfb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184617:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184623:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184634:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184639:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.184642:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184648:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184657:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02488b77800) 00010000:00010000:3.0:1777580312.184659:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.184661:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184667:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184698:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4abf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4c3 expref: 73 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184712:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4c3 expref: 72 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.184719:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:3.0:1777580312.184721:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.184725:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8400, rc 0) 00000100:00100000:1.0:1777580312.184766:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644224 00000100:00100000:3.0:1777580312.184774:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283036:x1863919946644736:12345-192.168.202.9@tcp:101:rm.500 Request processed in 542us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.184776:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644224 00000100:00100000:3.0:1777580312.184789:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19448 00000100:00100000:3.0:1777580312.184794:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833131580049 time 7833133081472 state 0x2 ref 0 00000100:00100000:1.0:1777580312.184843:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4169 00000100:00100000:1.0:1777580312.184852:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283040:x1863919946644224:12345-192.168.202.9@tcp:35:touch.500 00000004:00080000:1.0:1777580312.185187:0:187633:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x805:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1777580312.185539:0:187633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1859, 64 off127168 00010000:00010000:1.0:1777580312.185619:0:187633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185633:0:187633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185643:0:187633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185651:0:187633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185658:0:187633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185667:0:187633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185699:0:187633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580312.185784:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+322:283040:x1863919946644224:12345-192.168.202.9@tcp:35:touch.500 Request processed in 932us (12395us total) trans 8589950690 rc 0/0 00000100:00100000:1.0:1777580312.185793:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4169 00010000:00010000:1.0:1777580312.185842:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.185848:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185855:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.185858:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185865:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185877:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x805:0x0].0x0 (ffffa02427669f00) 00010000:00010000:1.0:1777580312.185879:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.185883:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185889:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4ac10 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.185900:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.185902:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.185904:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.186259:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.186270:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.186302:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.186425:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000088845b2a reply state 00000000fe1debaf transno 8589950691 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.186435:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.186511:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+323:283048:x1863919946644480:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2828us (4856us total) trans 8589950691 rc 0/0 00000100:00100000:2.0:1777580312.186520:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19447 00000100:00100000:2.0:1777580312.186528:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106785329 time 7833132533427 state 0x2 ref 0 00000100:00100000:0.0:1777580312.187387:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946643968 00000100:00100000:0.0:1777580312.187401:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946643968 00000100:00100000:0.0:1777580312.187470:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11912 00000100:00100000:0.0:1777580312.187481:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946643968:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.190279:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2362:x1863919946643968:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2785us (8793us total) trans 8589939006 rc 0/0 00000100:00100000:0.0:1777580312.191466:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11912 00010000:00010000:0.0:1777580312.191532:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191546:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191555:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191562:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.191569:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191579:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191600:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024185aa300) 00010000:00010000:0.0:1777580312.191604:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.191610:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.191628:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4abbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.200056:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.205725:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.205747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.208049:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644992 00000100:00100000:0.0:1777580312.208065:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644992 00000100:00100000:0.0:1777580312.208124:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833106785329 time 7833132533427 state 0x0 ref 1 00000100:00100000:0.0:1777580312.208167:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833132633427 time 7833132533427 state 0x1 ref 1 00000100:00100000:0.0:1777580312.208195:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946644864 00000100:00100000:0.0:1777580312.208198:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946644864 00000100:00100000:0.0:1777580312.208209:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833131580049 time 7833133081472 state 0x0 ref 1 00000100:00100000:0.0:1777580312.208216:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833133181472 time 7833133081472 state 0x1 ref 1 00000100:00100000:0.0:1777580312.208236:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946645120 00000100:00100000:0.0:1777580312.208239:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946645120 00000100:00100000:0.0:1777580312.208250:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833133181472 time 7833133081472 state 0x1 ref 2 00000100:00100000:0.0:1777580312.208268:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833132633427 time 7833157130320 state 0x0 ref 1 00000100:00100000:0.0:1777580312.208283:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+322:283046:x1863919946644992:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580312.208316:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.208347:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4ac1e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4d1 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208421:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4ac1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d1 expref: 323 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208460:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4ac1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d1 expref: 323 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208480:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa024814ca600) 00010000:00010000:0.0:1777580312.208484:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580312.208487:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:0.0:1777580312.208568:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+323:283046:x1863919946644992:12345-192.168.202.9@tcp:101:touch.500 Request processed in 290us (8526us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.208577:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19449 00000100:00100000:0.0:1777580312.208583:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833132633427 time 7833157130320 state 0x2 ref 0 00000100:00100000:0.0:1777580312.208611:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157575181 time 7833157475181 state 0x1 ref 2 00000100:00100000:0.0:1777580312.208620:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283037:x1863919946644864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.208627:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.208637:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ac25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4ca expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208691:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208701:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208710:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208736:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208742:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208749:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208889:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208897:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208903:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580312.208932:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x817:0x0]: returning size 0 00000004:00200000:0.0:1777580312.208936:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580312.208958:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208971:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208980:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.208987:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209004:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209010:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.209015:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209023:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209035:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.209037:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.209041:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209047:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ac2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209065:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209070:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209075:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209079:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.209082:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209097:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209105:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024814cad00) 00010000:00010000:0.0:1777580312.209107:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.209110:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209115:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ac33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209194:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ac25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ca expref: 75 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209207:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ca expref: 74 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209214:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:0.0:1777580312.209216:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.209218:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8400, rc 0) 00000100:00100000:0.0:1777580312.209252:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283037:x1863919946644864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 633us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.209260:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19450 00000100:00100000:0.0:1777580312.209282:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157575181 time 7833158145331 state 0x0 ref 1 00000100:00100000:0.0:1777580312.209294:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283039:x1863919946645120:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.209304:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.209319:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4ac41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4d8 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209352:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209361:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209370:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209384:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209391:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209399:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209455:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209464:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209470:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580312.209488:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x818:0x0]: returning size 0 00000004:00200000:0.0:1777580312.209491:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580312.209501:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209516:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209522:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209528:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209533:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209539:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.209542:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209548:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209556:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.209559:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.209562:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209567:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ac48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209577:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209582:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209593:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209599:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.209602:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209608:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209616:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024814ca000) 00010000:00010000:0.0:1777580312.209618:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.209621:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209628:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209653:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4ac41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d8 expref: 75 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209665:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d8 expref: 74 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209672:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:0.0:1777580312.209674:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.209676:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7000, rc 0) 00000100:00100000:0.0:1777580312.209703:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283039:x1863919946645120:12345-192.168.202.9@tcp:101:rm.500 Request processed in 411us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.209719:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19451 00000100:00100000:0.0:1777580312.209723:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157575181 time 7833158145331 state 0x2 ref 0 00010000:00010000:0.0:1777580312.209764:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209771:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209776:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209781:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.209783:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209789:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209798:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa024acb3ec00) 00010000:00010000:0.0:1777580312.209800:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.209803:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.209809:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ac17 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.216285:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.216380:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.216403:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.216430:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.216454:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.216487:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946645760 00000100:00100000:3.0:1777580312.216499:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946645760 00000100:00100000:3.0:1777580312.216547:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833132633427 time 7833157130320 state 0x0 ref 1 00000100:00100000:3.0:1777580312.216562:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157230320 time 7833157130320 state 0x1 ref 1 00000100:00100000:3.0:1777580312.216579:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646016 00000100:00100000:3.0:1777580312.216581:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646016 00000100:00100000:3.0:1777580312.216591:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157230320 time 7833157130320 state 0x1 ref 2 00000100:00100000:3.0:1777580312.216606:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165568678 time 7833165468678 state 0x1 ref 2 00000100:00100000:3.0:1777580312.216617:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+323:283048:x1863919946645760:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.216646:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.216675:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4ac5d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4ed expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.216776:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4ac5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ed expref: 324 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.216793:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4ac5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ed expref: 324 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.216827:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa02488b77800) 00010000:00010000:3.0:1777580312.216839:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.216844:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8e00, rc 0) 00000100:00100000:3.0:1777580312.216911:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+324:283048:x1863919946645760:12345-192.168.202.9@tcp:101:touch.500 Request processed in 295us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.216920:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19452 00000100:00100000:3.0:1777580312.216943:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165568678 time 7833165806371 state 0x0 ref 1 00000100:00100000:3.0:1777580312.216952:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+323:283051:x1863919946646016:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.216960:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.216971:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4f4 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217131:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217170:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217180:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217202:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217210:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217217:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580312.217750:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ad:0x0], index 1: 0 00010000:00010000:3.0:1777580312.217951:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4ac79 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217963:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4ac79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.217972:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4ac79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218008:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218015:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218023:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218029:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.218033:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218052:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218065:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.218067:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.218071:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218078:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4ac6b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580312.218095:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000afc2e65c reply state 00000000651fc1c4 transno 8589950692 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.218105:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580312.218175:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4ac64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4f4 expref: 326 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218191:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4ac79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4f4 expref: 325 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.218199:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:3.0:1777580312.218202:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.218204:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9200, rc 0) 00000100:00100000:3.0:1777580312.218261:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283051:x1863919946646016:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1309us (1830us total) trans 8589950692 rc 0/0 00000100:00100000:3.0:1777580312.218270:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19453 00000100:00100000:3.0:1777580312.218278:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165568678 time 7833165806371 state 0x2 ref 0 00000100:00100000:0.0:1777580312.218929:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946645248 00000100:00100000:0.0:1777580312.218941:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946645248 00000100:00100000:0.0:1777580312.219004:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946645376 00000100:00100000:0.0:1777580312.219008:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946645376 00000100:00100000:0.0:1777580312.219057:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11913 00000100:00100000:0.0:1777580312.219068:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2364:x1863919946645248:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.219085:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.219109:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4df expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.219154:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ce:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580312.219173:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.219176:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.219186:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 24 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.219203:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 24 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.219218:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6c00, rc 0) 00000100:00100000:0.0:1777580312.219264:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946645248:12345-192.168.202.9@tcp:101:rm.500 Request processed in 199us (2993us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.219270:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11913 00000100:00100000:0.0:1777580312.219289:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11914 00000100:00100000:0.0:1777580312.219296:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2363:x1863919946645376:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.219304:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.219317:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4e6 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.219336:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ab:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:0.0:1777580312.219353:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.219354:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.219359:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 13 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.219370:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 13 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.219379:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6000, rc 0) 00000100:00100000:0.0:1777580312.219398:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2363:x1863919946645376:12345-192.168.202.9@tcp:101:rm.500 Request processed in 103us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.219404:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11914 00000100:00100000:0.0:1777580312.219435:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946645632 00000100:00100000:0.0:1777580312.219439:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946645632 00000100:00100000:0.0:1777580312.219476:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4170 00000100:00100000:0.0:1777580312.219482:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283044:x1863919946645632:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580312.219805:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283044:x1863919946645632:12345-192.168.202.9@tcp:35:touch.500 Request processed in 322us (3423us total) trans 8589950693 rc 0/0 00000100:00100000:0.0:1777580312.219814:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4170 00000100:00100000:2.0:1777580312.236617:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.236657:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.236691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.241593:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.241735:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646144 00000100:00100000:1.0:1777580312.241735:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646272 00000100:00100000:3.0:1777580312.241750:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646144 00000100:00100000:1.0:1777580312.241750:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646272 00000100:00100000:1.0:1777580312.241813:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646400 00000100:00100000:1.0:1777580312.241816:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646400 00000100:00100000:2.0:1777580312.241906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.241937:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.241969:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580312.242001:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242015:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242023:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242030:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.242043:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242052:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242073:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0249076f900) 00010000:00010000:2.0:1777580312.242077:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.242082:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.242089:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4ac72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.242130:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646656 00000100:00100000:2.0:1777580312.242153:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646656 00000100:00100000:2.0:1777580312.242182:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833157575181 time 7833158145331 state 0x0 ref 1 00000100:00100000:2.0:1777580312.242195:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833158245331 time 7833158145331 state 0x1 ref 1 00000100:00100000:2.0:1777580312.242213:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647040 00000100:00100000:2.0:1777580312.242217:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647040 00000100:00100000:2.0:1777580312.242229:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165568678 time 7833165806371 state 0x0 ref 1 00000100:00100000:2.0:1777580312.242237:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165906371 time 7833165806371 state 0x1 ref 1 00000100:00100000:2.0:1777580312.242252:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647168 00000100:00100000:2.0:1777580312.242255:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647168 00000100:00100000:2.0:1777580312.242266:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833158245331 time 7833158145331 state 0x1 ref 2 00000100:00100000:3.0:1777580312.242571:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946646784 00000100:00100000:3.0:1777580312.242577:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946646784 00000100:00100000:3.0:1777580312.242608:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11915 00000100:00100000:3.0:1777580312.242619:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2361:x1863919946646272:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580312.246044:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833194990779 time 7833194890779 state 0x1 ref 2 00000100:00100000:2.0:1777580312.246119:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283033:x1863919946646656:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.246215:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.246254:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4a691 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ce expref: 74 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.246798:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11916 00000100:00100000:0.0:1777580312.246816:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946646144:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.246842:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.246866:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e4fb expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.246902:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15aa:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:0.0:1777580312.246933:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.246936:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.246946:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 25 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.246967:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 25 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.246981:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6a00, rc 0) 00000100:00100000:3.0:1777580312.246992:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2361:x1863919946646272:12345-192.168.202.9@tcp:2:touch.500 Request processed in 661us (6620us total) trans 8589938604 rc 0/0 00000100:00100000:3.0:1777580312.247006:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11915 00000100:00100000:3.0:1777580312.247043:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11917 00000100:00100000:3.0:1777580312.247053:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2361:x1863919946646784:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.247057:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946646144:12345-192.168.202.9@tcp:101:rm.500 Request processed in 250us (10457us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.247062:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11916 00000100:00100000:0.0:1777580312.247099:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165906371 time 7833195958804 state 0x0 ref 1 00000100:00100000:0.0:1777580312.247111:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283051:x1863919946647040:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580312.247170:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.247187:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4ac79 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4f4 expref: 327 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.247202:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:0.0:1777580312.247211:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.247783:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.247800:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.247813:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.247984:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ab6e04e1 reply state 00000000fc8a96ba transno 8589950694 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.247987:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4a5f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x814:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ab expref: 73 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.247994:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.248004:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:2.0:1777580312.248012:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.248032:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248043:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248051:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248064:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248070:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248075:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.248079:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+328:283051:x1863919946647040:12345-192.168.202.9@tcp:36:touch.500 Request processed in 968us (6140us total) trans 8589950694 rc 0/0 00000100:00100000:0.0:1777580312.248087:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19455 00000100:00100000:0.0:1777580312.248094:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165906371 time 7833195958804 state 0x2 ref 0 00000100:00100000:0.0:1777580312.248128:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833194990779 time 7833196991745 state 0x0 ref 2 00000100:00100000:0.0:1777580312.248159:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283053:x1863919946647168:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.248173:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.248183:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4acb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e509 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248212:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248227:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.248229:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.248235:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.248237:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.248515:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11918 00000100:00100000:1.0:1777580312.248526:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2361:x1863919946646400:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580312.248535:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.248551:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e502 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580312.248572:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15cf:0x0] initial LVB size: 0, mtime: 0x69f3b916, atime: 0x69f3b916, ctime: 0x69f3b916, blocks: 0x1 00010000:00010000:1.0:1777580312.248586:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.248588:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580312.248594:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.248609:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.248620:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248c032800, rc 0) 00000100:00100000:1.0:1777580312.248647:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2361:x1863919946646400:12345-192.168.202.9@tcp:101:rm.500 Request processed in 125us (11956us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.248653:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11918 00000040:00080000:2.0:1777580312.248740:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1864, 64 off127488 00010000:00010000:2.0:1777580312.248795:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.249321:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2361:x1863919946646784:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2268us (7660us total) trans 8589939007 rc 0/0 00000100:00100000:3.0:1777580312.249330:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11917 00010000:00010000:0.0:1777580312.249497:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249520:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249530:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249547:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249601:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249609:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249617:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249625:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.249631:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249639:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249650:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.249653:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.249657:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249664:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acbf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249679:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249686:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249698:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249703:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.249706:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249712:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249720:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024814ca000) 00010000:00010000:0.0:1777580312.249723:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.249725:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249730:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4acd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249772:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4acb1 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e509 expref: 328 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249783:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.249785:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.249789:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4acb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e509 expref: 328 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.249798:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7400, rc 0) 00000100:00100000:0.0:1777580312.249825:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283053:x1863919946647168:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1670us (7854us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580312.249852:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19456 00010000:00010000:2.0:1777580312.251937:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.251957:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.251969:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.251977:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.251985:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252013:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.252049:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252056:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252075:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252082:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.252088:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252097:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252111:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.252115:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.252120:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252128:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4acb8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x814:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252167:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252175:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252181:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252186:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.252189:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252205:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252215:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.252218:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.252221:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252228:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aca3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.252241:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007ae6f5da reply state 00000000bbcf03ec transno 8589950695 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.252251:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.252356:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283033:x1863919946646656:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6254us (10772us total) trans 8589950695 rc 0/0 00000100:00100000:2.0:1777580312.252367:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19454 00000100:00100000:2.0:1777580312.252378:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833194990779 time 7833196991745 state 0x2 ref 0 00010000:00010000:2.0:1777580312.252430:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.252436:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252442:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.252445:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252452:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252472:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x814:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.252475:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.252478:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252483:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4accd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x814:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.252501:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.252503:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.252505:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.267511:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.267550:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647296 00000100:00100000:3.0:1777580312.267561:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647296 00000100:00100000:3.0:1777580312.267610:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833165906371 time 7833195958804 state 0x0 ref 1 00000100:00100000:3.0:1777580312.267625:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833196058804 time 7833195958804 state 0x1 ref 1 00000100:00100000:3.0:1777580312.267652:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833196058804 time 7833216514497 state 0x0 ref 1 00000100:00100000:3.0:1777580312.267665:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283051:x1863919946647296:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580312.267678:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.267690:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.267696:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.267698:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.267704:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.267709:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.267717:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.267718:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4acdb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e510 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.267734:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa02427669d00) 00010000:00010000:0.0:1777580312.267738:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.267742:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.267748:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4ac9c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.267809:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4acdb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e510 expref: 327 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.267825:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4acdb lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e510 expref: 327 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.267854:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa02427669d00) 00010000:00010000:3.0:1777580312.267857:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.267859:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9c00, rc 0) 00000100:00100000:3.0:1777580312.267921:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283051:x1863919946647296:12345-192.168.202.9@tcp:101:touch.500 Request processed in 258us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.267930:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19457 00000100:00100000:3.0:1777580312.267936:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833196058804 time 7833216514497 state 0x2 ref 0 00010000:00010000:2.0:1777580312.268469:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268483:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268490:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268496:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.268500:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268507:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268520:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024acb3ec00) 00010000:00010000:2.0:1777580312.268522:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.268525:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.268545:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4acaa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.284685:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.284731:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.300780:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647552 00000100:00100000:0.0:1777580312.300800:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647552 00000100:00100000:0.0:1777580312.300875:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833194990779 time 7833196991745 state 0x0 ref 1 00000100:00100000:0.0:1777580312.300902:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833197091745 time 7833196991745 state 0x1 ref 1 00000100:00100000:0.0:1777580312.300948:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833197091745 time 7833249810099 state 0x0 ref 1 00000100:00100000:0.0:1777580312.300969:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283037:x1863919946647552:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580312.301058:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580312.301092:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ac3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ca expref: 73 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.301123:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4a6c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x817:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3e3 expref: 72 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.301152:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:0.0:1777580312.301166:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.301196:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.301213:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.301224:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302374:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302402:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302413:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302601:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302611:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.302619:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580312.303918:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1860, 64 off127232 00010000:00010000:0.0:1777580312.304028:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304045:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304056:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304065:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304072:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304078:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304107:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580312.304163:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304187:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304193:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304198:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.304204:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304211:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304223:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024814cad00) 00010000:00010000:0.0:1777580312.304226:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580312.304231:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.304236:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4acf0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307245:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.307265:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307279:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.307700:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307715:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307738:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x817:0x0].0x0 (ffffa024814cad00) 00010000:00010000:3.0:1777580312.307754:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.307762:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307768:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4acf7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.307793:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.307795:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.308410:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.310989:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311014:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311023:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311029:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.311055:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311063:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311083:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.311086:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.311091:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.311098:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4ace2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.311109:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fffe8987 reply state 000000004edcc1bb transno 8589950696 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.311119:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.311278:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283037:x1863919946647552:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10309us (26599us total) trans 8589950696 rc 0/0 00000100:00100000:0.0:1777580312.311289:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19458 00000100:00100000:0.0:1777580312.311299:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833197091745 time 7833249810099 state 0x2 ref 0 00000100:00100000:3.0:1777580312.311682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.311743:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.311773:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.315238:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647936 00000100:00100000:0.0:1777580312.315308:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647936 00000100:00100000:0.0:1777580312.315367:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833197091745 time 7833249810099 state 0x0 ref 1 00000100:00100000:0.0:1777580312.315383:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833249910099 time 7833249810099 state 0x1 ref 1 00000100:00100000:0.0:1777580312.315421:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833249910099 time 7833264283922 state 0x0 ref 1 00000100:00100000:0.0:1777580312.315440:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283053:x1863919946647936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.315472:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.315497:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4acfe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e517 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315600:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315617:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315629:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315646:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315653:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315659:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315754:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315762:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315769:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315776:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.315786:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.315795:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.316273:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946647808 00000100:00100000:1.0:1777580312.316280:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946647808 00000100:00100000:1.0:1777580312.316324:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946648192 00000100:00100000:1.0:1777580312.316328:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946648192 00000100:00100000:1.0:1777580312.316348:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4171 00000100:00100000:1.0:1777580312.316357:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283048:x1863919946647808:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580312.316765:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+331:283048:x1863919946647808:12345-192.168.202.9@tcp:35:touch.500 Request processed in 407us (32031us total) trans 8589950697 rc 0/0 00000100:00100000:1.0:1777580312.316788:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4171 00000100:00100000:1.0:1777580312.317093:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4172 00000100:00100000:1.0:1777580312.317104:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283046:x1863919946648192:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:0.0:1777580312.317555:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.317559:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.317568:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317576:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4ad05 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317599:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317607:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317614:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317621:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.317624:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317631:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317639:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024c6346a00) 00010000:00010000:0.0:1777580312.317642:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.317656:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317662:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317710:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4acfe lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e517 expref: 331 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317721:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.317724:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.317728:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4acfe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e517 expref: 331 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.317737:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6800, rc 0) 00000100:00100000:0.0:1777580312.317789:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283053:x1863919946647936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2357us (6108us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580312.317813:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19459 00000100:00100000:0.0:1777580312.317823:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833249910099 time 7833264283922 state 0x2 ref 0 00000100:00100000:1.0:1777580312.335220:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+329:283046:x1863919946648192:12345-192.168.202.9@tcp:35:touch.500 Request processed in 18099us (23456us total) trans 8589950698 rc 0/0 00000100:00100000:1.0:1777580312.335240:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4172 00000100:00100000:1.0:1777580312.339160:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946648320 00000100:00100000:1.0:1777580312.339178:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946648320 00000100:00100000:1.0:1777580312.339262:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11919 00000100:00100000:1.0:1777580312.339274:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2362:x1863919946648320:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580312.339680:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2362:x1863919946648320:12345-192.168.202.9@tcp:2:touch.500 Request processed in 408us (27904us total) trans 8589938605 rc 0/0 00000100:00100000:1.0:1777580312.339688:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11919 00000100:00100000:2.0:1777580312.343578:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.343619:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946648576 00000100:00100000:2.0:1777580312.343631:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946648576 00000100:00100000:2.0:1777580312.343679:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833249910099 time 7833264283922 state 0x0 ref 1 00000100:00100000:2.0:1777580312.343696:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833264383922 time 7833264283922 state 0x1 ref 1 00000100:00100000:2.0:1777580312.343719:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833264383922 time 7833292581991 state 0x0 ref 1 00000100:00100000:2.0:1777580312.343731:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283030:x1863919946648576:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.343805:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.343849:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4a778 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e414 expref: 73 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.343875:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4a556 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x810:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e37a expref: 72 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.343886:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa02499549700) 00010000:00010000:2.0:1777580312.343898:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.343930:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.343947:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.343983:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344001:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344008:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344014:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344200:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344208:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.344215:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.344873:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1865, 64 off127552 00010000:00010000:2.0:1777580312.348108:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348158:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348174:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348186:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348210:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348216:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348242:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.348533:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348541:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348547:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348553:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.348558:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348567:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348582:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580312.348586:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.348592:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348598:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad21 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348634:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348641:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348647:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348652:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.348655:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348661:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348668:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.348671:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.348674:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348680:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.348690:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009889c26a reply state 000000004c9c8d9d transno 8589950699 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.348700:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.348837:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283030:x1863919946648576:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5092us (5259us total) trans 8589950699 rc 0/0 00000100:00100000:2.0:1777580312.348850:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19460 00000100:00100000:2.0:1777580312.348866:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833264383922 time 7833292581991 state 0x2 ref 0 00010000:00010000:2.0:1777580312.348920:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.348927:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348934:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.348938:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.348946:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.355748:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x810:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580312.355753:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.355764:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.355774:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.355812:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.355814:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.355818:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.358502:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358524:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358533:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358539:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.358545:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358553:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358573:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024814ca000) 00010000:00010000:3.0:1777580312.358576:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.358595:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.358602:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4ace9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.369024:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.369060:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.369193:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.369227:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946648832 00000100:00100000:1.0:1777580312.369238:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946648832 00000100:00100000:1.0:1777580312.369561:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833196058804 time 7833216514497 state 0x0 ref 1 00000100:00100000:1.0:1777580312.369578:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833216614497 time 7833216514497 state 0x1 ref 1 00000100:00100000:1.0:1777580312.369601:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946649344 00000100:00100000:1.0:1777580312.369604:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946649344 00000100:00100000:1.0:1777580312.369617:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833264383922 time 7833292581991 state 0x0 ref 1 00000100:00100000:1.0:1777580312.369637:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833292681991 time 7833292581991 state 0x1 ref 1 00000100:00100000:1.0:1777580312.369658:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833216614497 time 7833318520277 state 0x0 ref 1 00000100:00100000:1.0:1777580312.369670:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+329:283054:x1863919946648832:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.369699:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.369724:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4ad2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e51e expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370025:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370043:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370056:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370072:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370078:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370083:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370190:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ad44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370199:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.370214:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580312.370226:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80d:0x0]: returning size 0 00010000:00010000:2.0:1777580312.370513:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370523:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370530:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370547:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.370552:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370560:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370575:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.370578:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.370583:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.370602:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ad1a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.370620:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946649088 00000100:00100000:0.0:1777580312.370628:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946649088 00000100:00100000:0.0:1777580312.370673:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4173 00000100:00100000:0.0:1777580312.370683:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+331:283051:x1863919946649088:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580312.371182:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283051:x1863919946649088:12345-192.168.202.9@tcp:35:touch.500 Request processed in 500us (2119us total) trans 8589950700 rc 0/0 00000100:00100000:0.0:1777580312.371191:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4173 00000100:00100000:2.0:1777580312.371570:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833292681991 time 7833320430276 state 0x0 ref 1 00000100:00100000:2.0:1777580312.371588:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283026:x1863919946649344:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.371647:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.371671:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4a6ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3ea expref: 71 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371691:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4a3b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e2e7 expref: 70 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371700:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa02484c59800) 00010000:00010000:2.0:1777580312.371708:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.371735:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371750:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371761:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371775:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371782:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371789:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371900:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371909:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.371917:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.372486:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1866, 64 off127616 00010000:00010000:2.0:1777580312.372550:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372561:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372581:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372589:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372596:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372603:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372627:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.372648:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372655:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372662:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372669:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.372674:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372681:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372692:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa0248e788000) 00010000:00010000:2.0:1777580312.372695:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.372703:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372710:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ad59 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372728:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372734:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372740:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372746:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.372748:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372755:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372763:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.372766:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.372769:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372776:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ad4b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.372784:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004bec4182 reply state 000000006fb7e20b transno 8589950701 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.372802:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.372909:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283026:x1863919946649344:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1323us (3712us total) trans 8589950701 rc 0/0 00000100:00100000:2.0:1777580312.372918:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19462 00000100:00100000:2.0:1777580312.372925:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833292681991 time 7833320430276 state 0x2 ref 0 00010000:00010000:2.0:1777580312.372975:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.372982:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372988:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.372992:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.372998:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.373007:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80c:0x0].0x0 (ffffa0248e788000) 00010000:00010000:2.0:1777580312.373009:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.373012:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.373016:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad60 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.373030:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.373031:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.373033:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.384561:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384582:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384590:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384597:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.384602:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384610:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384629:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.384633:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.384638:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384644:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ad36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384660:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384681:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384687:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384693:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.384696:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384702:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384710:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185aa400) 00010000:00010000:1.0:1777580312.384713:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.384716:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384722:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ad3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384812:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4ad2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e51e expref: 333 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384838:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ad44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e51e expref: 332 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.384847:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580312.384849:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580312.384858:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:1.0:1777580312.384969:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283054:x1863919946648832:12345-192.168.202.9@tcp:101:touch.500 Request processed in 15298us (15955us total) trans 8589950702 rc 0/0 00000100:00100000:1.0:1777580312.384980:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19461 00000100:00100000:1.0:1777580312.384990:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833216614497 time 7833318520277 state 0x2 ref 0 00000100:00100000:0.0:1777580312.400599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.400663:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946649600 00000100:00100000:0.0:1777580312.400675:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946649600 00000100:00100000:0.0:1777580312.400723:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833216614497 time 7833318520277 state 0x0 ref 1 00000100:00100000:0.0:1777580312.400738:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833318620277 time 7833318520277 state 0x1 ref 1 00010000:00010000:1.0:1777580312.400846:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400860:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400868:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400875:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.400880:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400889:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400911:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0248e788800) 00010000:00010000:1.0:1777580312.400914:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.400920:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.400926:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4ad52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.401007:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833318620277 time 7833349868385 state 0x0 ref 1 00000100:00100000:0.0:1777580312.401021:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283054:x1863919946649600:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580312.401102:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.401121:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ad44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e51e expref: 332 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.401174:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:0.0:1777580312.401179:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.401704:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.401724:0:191688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 69 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.401734:0:191688:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.401776:0:191688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 69 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.401792:0:191688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 69 pid: 207396 timeout: 7933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.401846:0:191688:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917477504:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580312.401952:0:191688:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239e11ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580312.433523:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.433620:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.433777:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.433989:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946649856 00000100:00100000:0.0:1777580312.434004:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946649856 00000100:00100000:0.0:1777580312.434055:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833292681991 time 7833320430276 state 0x0 ref 1 00000100:00100000:0.0:1777580312.434072:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833320530276 time 7833320430276 state 0x1 ref 1 00000100:00100000:0.0:1777580312.434096:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650112 00000100:00100000:0.0:1777580312.434099:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650112 00000100:00100000:0.0:1777580312.434111:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833320530276 time 7833320430276 state 0x1 ref 2 00000100:00100000:0.0:1777580312.434129:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833383091329 time 7833382991329 state 0x1 ref 2 00000100:00100000:0.0:1777580312.434206:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+70:283028:x1863919946649856:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580312.434657:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580312.434693:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4a755 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f1 expref: 70 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434718:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4a4c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e349 expref: 69 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434733:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa02491fc3500) 00010000:00010000:0.0:1777580312.434743:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.434773:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434897:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434911:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434928:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434936:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.434943:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.435094:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.435101:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.435108:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.435942:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833383091329 time 7833384798898 state 0x0 ref 2 00000100:00100000:2.0:1777580312.435978:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283050:x1863919946650112:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.436029:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.436053:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4abed lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4bc expref: 332 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436072:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4aa88 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e492 expref: 331 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436081:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa02427669600) 00010000:00010000:2.0:1777580312.436090:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.436104:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436114:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436122:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436169:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436178:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436184:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436258:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436274:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436280:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.436577:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1861, 64 off127296 00010000:00010000:2.0:1777580312.436641:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436650:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436659:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436667:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436673:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436680:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436713:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.436736:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.436739:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.436743:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436745:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.436766:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580312.436910:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1867, 64 off127680 00010000:00010000:0.0:1777580312.436959:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.436968:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.436975:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.436987:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.436993:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.436997:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437016:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580312.437028:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437033:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437038:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437043:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.437047:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437054:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437064:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa024814ca000) 00010000:00010000:0.0:1777580312.437067:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580312.437071:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437085:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4ad83 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437106:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437111:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437116:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437119:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.437122:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437127:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437150:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.437153:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.437155:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437160:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4ad75 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.437169:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000005635540 reply state 00000000a0464182 transno 8589950704 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.437180:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.437283:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+70:283028:x1863919946649856:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3078us (4038us total) trans 8589950704 rc 0/0 00000100:00100000:0.0:1777580312.437293:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19464 00000100:00100000:0.0:1777580312.437368:0:191688:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917477504:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580312.437393:0:191688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.437419:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650240 00000100:00100000:0.0:1777580312.437635:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650240 00010000:00010000:0.0:1777580312.437669:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 70 pid: 207396 timeout: 7933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.437700:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4406 00000100:00100000:0.0:1777580312.437709:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+70:2362:x1863919946650240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580312.437722:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.437728:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 70 pid: 207396 timeout: 7933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437740:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 70 pid: 207396 timeout: 7933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437757:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c800/0xcb2b2f2f7e4a771 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3f8 expref: 70 pid: 207396 timeout: 7933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437768:0:190365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:0.0:1777580312.437773:0:190365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.437792:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.438119:0:190365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.438175:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580312.438210:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+69:2362:x1863919946650240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 502us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.438218:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4406 00010000:00010000:0.0:1777580312.438540:0:191688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.438549:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.438720:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007a7285df reply state 00000000fc58b64a transno 8589950705 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.438729:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.438821:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283054:x1863919946649600:12345-192.168.202.9@tcp:36:touch.500 Request processed in 37802us (38235us total) trans 8589950705 rc 0/0 00000100:00100000:0.0:1777580312.438841:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19463 00000100:00100000:0.0:1777580312.438849:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833318620277 time 7833349868385 state 0x2 ref 0 00010000:00010000:1.0:1777580312.439267:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.439275:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439285:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439299:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:1.0:1777580312.439302:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.439306:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439312:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ad9f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439327:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.439331:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439336:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.439339:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439344:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439368:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80e:0x0].0x0 (ffffa024814ca000) 00010000:00010000:1.0:1777580312.439370:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.439373:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439378:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149800/0xcb2b2f2f7e4ada6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.439391:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.439393:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.439395:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.440964:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.451921:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.451940:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.451958:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.451981:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e6:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.451984:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.451990:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.451997:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4ad98 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452049:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452057:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452063:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452068:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.452071:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452111:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452120:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.452122:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.452125:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.452129:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4ad8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.452170:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f1c1449e reply state 00000000acaf9863 transno 8589950703 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.452180:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.452315:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283050:x1863919946650112:12345-192.168.202.9@tcp:36:rm.500 Request processed in 16341us (18687us total) trans 8589950703 rc 0/0 00000100:00100000:2.0:1777580312.452327:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19465 00000100:00100000:2.0:1777580312.452337:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833383091329 time 7833384798898 state 0x2 ref 0 00010000:00010000:2.0:1777580312.457419:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457441:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457449:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457456:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.457479:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457487:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457509:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580312.457512:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.457516:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.457522:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ad7c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.465195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.465464:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.465491:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.465512:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.465536:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.465580:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650368 00000100:00100000:3.0:1777580312.465594:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650368 00000100:00100000:3.0:1777580312.465646:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833318620277 time 7833349868385 state 0x0 ref 1 00000100:00100000:3.0:1777580312.465661:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833349968385 time 7833349868385 state 0x1 ref 1 00000100:00100000:3.0:1777580312.465681:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650496 00000100:00100000:3.0:1777580312.465683:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650496 00000100:00100000:3.0:1777580312.465694:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833383091329 time 7833384798898 state 0x0 ref 1 00000100:00100000:3.0:1777580312.465700:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833384898898 time 7833384798898 state 0x1 ref 1 00000100:00100000:3.0:1777580312.465710:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650624 00000100:00100000:3.0:1777580312.465712:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650624 00000100:00100000:3.0:1777580312.465721:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833384898898 time 7833384798898 state 0x1 ref 2 00000100:00100000:3.0:1777580312.465730:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650752 00000100:00100000:3.0:1777580312.465732:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650752 00000100:00100000:3.0:1777580312.465741:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833384898898 time 7833384798898 state 0x1 ref 3 00000100:00100000:3.0:1777580312.465746:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946650880 00000100:00100000:3.0:1777580312.465764:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946650880 00000100:00100000:3.0:1777580312.465776:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833384898898 time 7833384798898 state 0x1 ref 4 00000100:00100000:3.0:1777580312.465789:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833349968385 time 7833414651685 state 0x0 ref 1 00000100:00100000:3.0:1777580312.465799:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283054:x1863919946650368:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.465841:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.465869:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4adad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e525 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.465947:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4adad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e525 expref: 338 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.465964:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9600/0xcb2b2f2f7e4adad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e525 expref: 338 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.465984:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:3.0:1777580312.465987:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.465990:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9600, rc 0) 00000100:00100000:3.0:1777580312.466052:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283054:x1863919946650368:12345-192.168.202.9@tcp:101:touch.500 Request processed in 255us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.466060:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19466 00000100:00100000:3.0:1777580312.466065:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833349968385 time 7833414651685 state 0x2 ref 0 00000100:00100000:3.0:1777580312.466087:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833415051758 time 7833414951758 state 0x1 ref 4 00000100:00100000:3.0:1777580312.466095:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283064:x1863919946650496:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.466103:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.466118:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4adb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e52c expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466198:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466207:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466217:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466231:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466237:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466243:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466373:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466380:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466386:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580312.466414:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ea:0x0]: returning size 0 00000004:00200000:3.0:1777580312.466418:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580312.466439:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466456:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466464:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466471:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466477:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466482:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.466486:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466493:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466504:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.466506:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.466509:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466515:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4adbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466529:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466534:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466544:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466549:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.466551:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466556:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466562:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0249076f700) 00010000:00010000:3.0:1777580312.466564:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.466566:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466571:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4adc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466600:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4adb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e52c expref: 339 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466611:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e52c expref: 338 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466617:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa02427669d00) 00010000:00010000:3.0:1777580312.466620:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.466622:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7e00, rc 0) 00000100:00100000:3.0:1777580312.466649:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283064:x1863919946650496:12345-192.168.202.9@tcp:101:rm.500 Request processed in 554us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.466662:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19467 00000100:00100000:3.0:1777580312.466683:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833415646908 time 7833415546908 state 0x1 ref 3 00000100:00100000:3.0:1777580312.466693:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283060:x1863919946650624:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.466702:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.466709:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4add0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e533 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466759:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466768:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466776:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466787:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466795:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466801:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466863:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466871:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466884:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580312.466903:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e8:0x0]: returning size 0 00000004:00200000:3.0:1777580312.466906:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580312.466914:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466922:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466928:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466933:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466938:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466943:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.466945:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466951:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466957:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.466959:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.466961:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466975:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4add7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466984:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466989:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466994:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.466998:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.467000:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467005:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467010:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0249076fc00) 00010000:00010000:3.0:1777580312.467012:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.467015:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467020:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4adde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467038:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4add0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e533 expref: 339 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467061:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e533 expref: 338 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467067:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa024814ca600) 00010000:00010000:3.0:1777580312.467069:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.467071:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7c00, rc 0) 00000100:00100000:3.0:1777580312.467091:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283060:x1863919946650624:12345-192.168.202.9@tcp:101:rm.500 Request processed in 399us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.467096:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19468 00000100:00100000:3.0:1777580312.467110:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416073691 time 7833415973691 state 0x1 ref 2 00000100:00100000:3.0:1777580312.467118:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283061:x1863919946650752:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.467125:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.467131:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4adec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e53a expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467184:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467191:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467197:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467207:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467222:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.467228:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.467555:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416073691 time 7833416415886 state 0x0 ref 2 00000100:00100000:0.0:1777580312.467572:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283055:x1863919946650880:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.467589:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.467599:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ae01 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e541 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467629:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467637:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467645:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467655:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467660:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.467666:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469225:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469245:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469254:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469261:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.469267:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469274:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469292:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa0248e788000) 00010000:00010000:2.0:1777580312.469295:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.469311:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469319:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4ad91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469366:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469373:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469379:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469384:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.469386:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469392:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469400:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:2.0:1777580312.469403:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.469405:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.469410:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ad6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.473684:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.473709:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.473725:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580312.473771:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e7:0x0]: returning size 0 00000004:00200000:0.0:1777580312.473784:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580312.473817:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474237:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474322:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474329:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474337:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474344:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.474353:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474362:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474378:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.474382:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.474388:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474395:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149a00/0xcb2b2f2f7e4ae08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474411:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474510:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474517:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474522:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.474526:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474532:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474544:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024814cad00) 00010000:00010000:0.0:1777580312.474547:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.474551:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474556:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148600/0xcb2b2f2f7e4ae0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474613:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4ae01 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e541 expref: 338 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474634:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e541 expref: 337 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.474644:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa02427669200) 00000100:00100000:3.0:1777580312.474649:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580312.474651:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.474661:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000100:00100000:3.0:1777580312.474707:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.474799:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651008 00000100:00100000:1.0:1777580312.474811:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651008 00000100:00100000:1.0:1777580312.474883:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651264 00000100:00100000:1.0:1777580312.474887:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651264 00000100:00100000:1.0:1777580312.474915:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11920 00000100:00100000:1.0:1777580312.474926:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2363:x1863919946651008:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580312.475111:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.475590:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283055:x1863919946650880:12345-192.168.202.9@tcp:101:rm.500 Request processed in 8019us (10049us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.475604:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19470 00000100:00100000:0.0:1777580312.475654:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651136 00000100:00100000:0.0:1777580312.475660:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651136 00000100:00100000:0.0:1777580312.475694:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11921 00000100:00100000:0.0:1777580312.475703:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2363:x1863919946651264:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.475715:0:205896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.475742:0:205896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e54f expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.475778:0:205896:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ad:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:0.0:1777580312.475796:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.475799:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.475809:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 19 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.475840:0:205896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 19 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.475855:0:205896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149200, rc 0) 00000100:00100000:0.0:1777580312.475896:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2363:x1863919946651264:12345-192.168.202.9@tcp:101:rm.500 Request processed in 194us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.475902:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11921 00000100:00100000:0.0:1777580312.475921:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11922 00000100:00100000:0.0:1777580312.475927:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2363:x1863919946651136:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.475947:0:205896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.475958:0:205896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e548 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.475971:0:205896:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ac:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:0.0:1777580312.475981:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.475983:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.475988:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 19 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.475999:0:205896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 19 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.476008:0:205896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149800, rc 0) 00000100:00100000:0.0:1777580312.476029:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2363:x1863919946651136:12345-192.168.202.9@tcp:101:rm.500 Request processed in 102us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.476035:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11922 00002000:00010000:1.0:1777580312.476561:0:188246:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x15a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777580312.476566:0:188246:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x15a5:0x0] updating lvb mtime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.476568:0:188246:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x15a5:0x0] updating lvb atime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.476571:0:188246:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x15a5:0x0] updating lvb ctime from disk: 1777580310 -> 1777580311 00002000:00010000:1.0:1777580312.476574:0:188246:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x15a5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1777580312.476624:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2363:x1863919946651008:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1699us (1998us total) trans 8589938606 rc 0/0 00000100:00100000:1.0:1777580312.476633:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11920 00010000:00010000:3.0:1777580312.478014:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478031:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478041:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580312.478073:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7e9:0x0]: returning size 0 00000004:00200000:3.0:1777580312.478076:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580312.478092:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478100:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478107:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478112:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478131:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478190:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.478195:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478203:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478215:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.478218:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.478221:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478226:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4adf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478238:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478242:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478245:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478248:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.478250:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478261:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478266:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0249076f500) 00010000:00010000:3.0:1777580312.478268:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.478269:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478273:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4adfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478305:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4adec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e53a expref: 337 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478315:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e53a expref: 336 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.478320:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa02488b77800) 00010000:00010000:3.0:1777580312.478322:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.478323:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680ee00, rc 0) 00000100:00100000:3.0:1777580312.478379:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+336:283061:x1863919946650752:12345-192.168.202.9@tcp:101:rm.500 Request processed in 11261us (12866us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.478386:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19469 00000100:00100000:3.0:1777580312.478393:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416073691 time 7833416415886 state 0x2 ref 0 00000100:00100000:3.0:1777580312.486028:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.486081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.486129:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651392 00000100:00100000:3.0:1777580312.491075:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.492454:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651904 00000100:00100000:1.0:1777580312.492486:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651904 00000100:00100000:1.0:1777580312.492569:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4174 00000100:00100000:1.0:1777580312.492581:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+336:283054:x1863919946651904:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580312.492921:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283054:x1863919946651904:12345-192.168.202.9@tcp:35:touch.500 Request processed in 341us (1853us total) trans 8589950706 rc 0/0 00000100:00100000:1.0:1777580312.492931:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4174 00000100:00100000:1.0:1777580312.492973:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946651648 00000100:00100000:1.0:1777580312.492979:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651648 00000100:00100000:1.0:1777580312.493006:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416073691 time 7833416415886 state 0x0 ref 1 00000100:00100000:1.0:1777580312.493020:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416515886 time 7833416415886 state 0x1 ref 1 00000100:00100000:3.0:1777580312.493030:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.493051:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416515886 time 7833441911829 state 0x0 ref 1 00000100:00100000:1.0:1777580312.493064:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283031:x1863919946651648:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580312.493110:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580312.493176:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4a708 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e406 expref: 68 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.493202:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4a580 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x811:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e381 expref: 67 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.493216:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:1.0:1777580312.493231:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580312.493356:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946652032 00000100:00100000:3.0:1777580312.493364:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946652032 00000100:00100000:3.0:1777580312.493404:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11923 00000100:00100000:3.0:1777580312.493411:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2364:x1863919946652032:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.493428:0:189456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.493453:0:189456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e55d expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580312.493490:0:189456:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d1:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:3.0:1777580312.493507:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.493510:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.493520:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 13 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.493538:0:189456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 13 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.493552:0:189456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680e600, rc 0) 00000100:00100000:3.0:1777580312.493601:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2364:x1863919946652032:12345-192.168.202.9@tcp:101:rm.500 Request processed in 190us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.493608:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11923 00010000:00010000:1.0:1777580312.496597:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496628:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496663:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496684:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496692:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496698:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496884:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496893:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.496900:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580312.497519:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1862, 64 off127360 00010000:00010000:1.0:1777580312.497595:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497607:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497616:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497624:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497639:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497645:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497677:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.497706:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497713:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497718:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497724:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.497729:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497737:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497751:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580312.497754:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580312.497759:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497766:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4ae47 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497797:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497805:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497810:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497815:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.497818:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497825:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497848:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.497851:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.497855:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.497860:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4ae39 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.497870:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f4d7bc07 reply state 000000005a2e65c7 transno 8589950707 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.497879:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.497993:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283031:x1863919946651648:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4926us (11905us total) trans 8589950707 rc 0/0 00000100:00100000:1.0:1777580312.498004:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19471 00000100:00100000:1.0:1777580312.498019:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416515886 time 7833441911829 state 0x2 ref 0 00010000:00010000:3.0:1777580312.499301:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.499312:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.499320:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.499339:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.499346:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.499360:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x811:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:3.0:1777580312.499362:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.499366:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.499370:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4ae4e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.499392:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.499393:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.499394:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.500835:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.502600:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946651392 00000100:00100000:3.0:1777580312.503245:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11924 00000100:00100000:3.0:1777580312.503257:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2362:x1863919946651392:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580312.503275:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.503298:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e556 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580312.503325:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d0:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:3.0:1777580312.503344:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.503346:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580312.503354:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 14 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.503391:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 14 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.503403:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f000, rc 0) 00000100:00100000:3.0:1777580312.503476:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2362:x1863919946651392:12345-192.168.202.9@tcp:101:rm.500 Request processed in 221us (17456us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.503483:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11924 00000100:00100000:0.0:1777580312.506414:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946652288 00000100:00100000:0.0:1777580312.506431:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946652288 00000100:00100000:0.0:1777580312.506489:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833349968385 time 7833414651685 state 0x0 ref 1 00000100:00100000:0.0:1777580312.506507:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833414751685 time 7833414651685 state 0x1 ref 1 00000100:00100000:0.0:1777580312.506551:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833414751685 time 7833455412784 state 0x0 ref 1 00000100:00100000:0.0:1777580312.506570:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283057:x1863919946652288:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580312.506595:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.506637:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ae5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e564 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506840:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506859:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506873:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506892:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506900:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.506907:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.507291:0:187653:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239ce09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:187653:1863919917477632:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777580312.507347:0:187653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580312.507380:0:187653:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248a0c9540 going to sleep for 11 seconds 00000004:00080000:0.0:1777580312.509777:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d2:0x0], index 0: 0 00010000:00010000:0.0:1777580312.510056:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ae71 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510077:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ae71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510093:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ae71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510166:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510186:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510194:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510200:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.510205:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510213:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.510226:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.510230:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.510237:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510416:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510442:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510448:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510453:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.510456:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510462:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510472:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa024185aa400) 00010000:00010000:2.0:1777580312.510475:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.510478:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.510483:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4ae40 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.511230:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917477632 00000100:00100000:2.0:1777580312.511245:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917477632 00000100:00100000:2.0:1777580312.511338:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11925 00000100:00100000:2.0:1777580312.511350:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:187653:x1863919917477632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1777580312.511414:0:205905:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 5602 00010000:00010000:0.0:1777580312.511887:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4ae63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.511912:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003e2015f1 reply state 00000000cc4696de transno 8589950708 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.511922:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580312.511982:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4ae5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e564 expref: 340 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.511999:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ae71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e564 expref: 339 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.512022:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa02481358200) 00010000:00010000:0.0:1777580312.512025:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.512029:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9800, rc 0) 00000100:00100000:0.0:1777580312.512127:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+340:283057:x1863919946652288:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5564us (11305us total) trans 8589950708 rc 0/0 00000100:00100000:0.0:1777580312.512154:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19472 00000100:00100000:0.0:1777580312.512164:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833414751685 time 7833455412784 state 0x2 ref 0 00000100:00100000:2.0:1777580312.514441:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:187653:x1863919917477632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3086us (7086us total) trans 8589939008 rc 0/0 00000100:00100000:2.0:1777580312.514456:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11925 00000100:00100000:3.0:1777580312.514501:0:187653:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239ce09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:187653:1863919917477632:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1777580312.514526:0:187653:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x15d2:0x0]-[0x240000400:0x1601:0x0] 00000100:00100000:3.0:1777580312.523200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580312.523278:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523292:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523300:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523305:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.523310:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523339:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523355:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02481358f00) 00010000:00010000:3.0:1777580312.523358:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.523362:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.523368:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4ae6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.524551:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946652416 00000100:00100000:2.0:1777580312.524569:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946652416 00000100:00100000:2.0:1777580312.524624:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833416515886 time 7833441911829 state 0x0 ref 1 00000100:00100000:2.0:1777580312.524639:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833442011829 time 7833441911829 state 0x1 ref 1 00000100:00100000:2.0:1777580312.524675:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833442011829 time 7833473536940 state 0x0 ref 1 00000100:00100000:2.0:1777580312.524689:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+67:283027:x1863919946652416:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.524720:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.524746:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ae7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e56b expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524825:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524852:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524866:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524884:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524891:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.524898:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525031:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525052:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525060:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.525093:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x80d:0x0]: returning size 0 00000004:00200000:2.0:1777580312.525098:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.525120:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525156:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525167:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525174:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525182:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525188:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.525191:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525198:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525208:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.525217:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.525222:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525228:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4ae86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525244:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525250:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525257:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525262:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.525265:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525270:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.525278:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0248e788000) 00010000:00010000:2.0:1777580312.525280:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.526536:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.526556:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4ae8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.526620:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4ae7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e56b expref: 69 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.526652:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e56b expref: 68 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.526660:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:2.0:1777580312.526662:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.526665:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee8600, rc 0) 00000100:00100000:3.0:1777580312.527177:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283027:x1863919946652416:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2481us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.527191:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19473 00000100:00100000:3.0:1777580312.527200:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833442011829 time 7833473536940 state 0x2 ref 0 00000100:00100000:3.0:1777580312.531174:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.531238:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.531270:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946652672 00000100:00100000:3.0:1777580312.531280:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946652672 00000100:00100000:3.0:1777580312.531319:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833414751685 time 7833455412784 state 0x0 ref 1 00000100:00100000:3.0:1777580312.531332:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833455512784 time 7833455412784 state 0x1 ref 1 00000100:00100000:3.0:1777580312.531360:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946652928 00000100:00100000:3.0:1777580312.531363:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946652928 00000100:00100000:3.0:1777580312.531375:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833455512784 time 7833455412784 state 0x1 ref 2 00000100:00100000:3.0:1777580312.531392:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833480355465 time 7833480255465 state 0x1 ref 2 00000100:00100000:3.0:1777580312.531415:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+340:283057:x1863919946652672:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580312.531541:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.531566:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4ae71 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e564 expref: 340 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.531589:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa02481358200) 00010000:00010000:3.0:1777580312.531598:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580312.531744:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.531758:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.531768:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.532156:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833480355465 time 7833480993237 state 0x0 ref 2 00000100:00100000:1.0:1777580312.532190:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+339:283059:x1863919946652928:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.532212:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.532234:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4aea2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e572 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580312.532432:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e7233d6 reply state 00000000e03d32b5 transno 8589950709 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.532443:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580312.532616:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+341:283057:x1863919946652672:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1202us (1625us total) trans 8589950709 rc 0/0 00000100:00100000:3.0:1777580312.532624:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19474 00010000:00010000:1.0:1777580312.534178:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.534199:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.534211:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.534230:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.534237:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.534254:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535254:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535270:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535293:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535300:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.535305:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535314:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535329:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa0249076f500) 00010000:00010000:3.0:1777580312.535332:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.535336:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.535341:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ae9b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.536274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.536363:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946653056 00000100:00100000:2.0:1777580312.536378:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946653056 00000100:00100000:2.0:1777580312.536533:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833481093237 time 7833480993237 state 0x1 ref 2 00000004:00080000:1.0:1777580312.537006:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ae:0x0], index 1: 0 00010000:00010000:1.0:1777580312.537355:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aeb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537390:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537403:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537450:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537458:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537464:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537470:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.537475:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537482:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537494:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.537497:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.537502:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537508:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4aea9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.537523:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac90614e reply state 0000000006853fa5 transno 8589950710 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.537541:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580312.537586:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4aea2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e572 expref: 343 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537603:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e572 expref: 342 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537610:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024185aa600) 00010000:00010000:1.0:1777580312.537612:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580312.537615:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4a00, rc 0) 00000100:00100000:1.0:1777580312.537713:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283059:x1863919946652928:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5537us (6474us total) trans 8589950710 rc 0/0 00000100:00100000:1.0:1777580312.537725:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19475 00000100:00100000:1.0:1777580312.537771:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833481093237 time 7833486631279 state 0x0 ref 1 00000100:00100000:1.0:1777580312.537786:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283057:x1863919946653056:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.537809:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.537824:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aec5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e579 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537884:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e579 expref: 343 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537896:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e579 expref: 343 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.537929:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa024185aac00) 00010000:00010000:1.0:1777580312.537933:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580312.537936:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00000100:00100000:3.0:1777580312.537967:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.537972:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283057:x1863919946653056:12345-192.168.202.9@tcp:101:touch.500 Request processed in 187us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.537980:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19476 00000100:00100000:1.0:1777580312.537984:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833481093237 time 7833486631279 state 0x2 ref 0 00000100:00100000:1.0:1777580312.542483:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946653312 00000100:00100000:1.0:1777580312.542503:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946653312 00000100:00100000:1.0:1777580312.542564:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833442011829 time 7833473536940 state 0x0 ref 1 00000100:00100000:1.0:1777580312.542581:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833473636940 time 7833473536940 state 0x1 ref 1 00000100:00100000:1.0:1777580312.542612:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833473636940 time 7833491474010 state 0x0 ref 1 00000100:00100000:1.0:1777580312.542631:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283027:x1863919946653312:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580312.542705:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580312.542741:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4ae94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e56b expref: 68 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542770:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4a46f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e311 expref: 67 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542787:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580312.542792:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.542859:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542877:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542891:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542909:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542915:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.542922:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.543076:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.543085:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.543092:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580312.544992:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1863, 64 off127424 00010000:00010000:1.0:1777580312.545087:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545109:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545168:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545179:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545186:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545193:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.545215:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.546230:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546336:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546345:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546352:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.546357:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546366:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546381:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:1.0:1777580312.546384:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580312.546402:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546409:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4aeda lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546438:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546444:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546450:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546455:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.546457:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546463:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546470:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.546473:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.546476:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.546482:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4aecc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.546493:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d2f0ecdd reply state 0000000079f68eeb transno 8589950711 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.546513:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.546670:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283027:x1863919946653312:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4040us (8703us total) trans 8589950711 rc 0/0 00000100:00100000:1.0:1777580312.546682:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19477 00000100:00100000:1.0:1777580312.546692:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833473636940 time 7833491474010 state 0x2 ref 0 00010000:00010000:2.0:1777580312.547234:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.547244:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.547253:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.547257:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.547265:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.547278:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80d:0x0].0x0 (ffffa02486090100) 00010000:00010000:2.0:1777580312.547280:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.547284:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.547288:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4aee1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.547315:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.547317:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.547319:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.548273:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548291:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548299:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548306:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.548328:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548335:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548354:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024185aa500) 00010000:00010000:3.0:1777580312.548358:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.548363:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.548371:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4aeb0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.549222:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.549264:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946653696 00000100:00100000:3.0:1777580312.549274:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946653696 00000100:00100000:3.0:1777580312.549314:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833481093237 time 7833486631279 state 0x0 ref 1 00000100:00100000:3.0:1777580312.549327:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833486731279 time 7833486631279 state 0x1 ref 1 00000100:00100000:3.0:1777580312.549358:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833486731279 time 7833498220249 state 0x0 ref 1 00000100:00100000:3.0:1777580312.549369:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283059:x1863919946653696:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580312.549431:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580312.549451:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4aeb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e572 expref: 342 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.551220:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024185aa600) 00010000:00010000:3.0:1777580312.551239:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580312.551341:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.551357:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.551370:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580312.552809:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d818c9f1 reply state 000000002b4925e3 transno 8589950712 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.552823:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580312.554368:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283059:x1863919946653696:12345-192.168.202.9@tcp:36:touch.500 Request processed in 4989us (5144us total) trans 8589950712 rc 0/0 00000100:00100000:3.0:1777580312.554384:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19478 00000100:00100000:3.0:1777580312.554395:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833486731279 time 7833498220249 state 0x2 ref 0 00000100:00100000:2.0:1777580312.555423:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.555496:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946653440 00000100:00100000:1.0:1777580312.555511:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946653440 00000100:00100000:2.0:1777580312.555570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.555585:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11926 00000100:00100000:1.0:1777580312.555596:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2363:x1863919946653440:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580312.556188:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946653952 00000100:00100000:2.0:1777580312.556198:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946653952 00000100:00100000:2.0:1777580312.556237:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833486731279 time 7833498220249 state 0x0 ref 1 00000100:00100000:2.0:1777580312.556250:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833498320249 time 7833498220249 state 0x1 ref 1 00000100:00100000:2.0:1777580312.556274:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833498320249 time 7833505136813 state 0x0 ref 1 00000100:00100000:2.0:1777580312.556287:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283063:x1863919946653952:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.556307:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.556327:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aeef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e580 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556509:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556525:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556538:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556552:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556572:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.556579:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580312.558117:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d3:0x0], index 0: 0 00000100:00100000:1.0:1777580312.559129:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2363:x1863919946653440:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3525us (3700us total) trans 8589939009 rc 0/0 00000100:00100000:1.0:1777580312.559168:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11926 00010000:00010000:3.0:1777580312.559714:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.559728:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.559736:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.559742:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.559746:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.559753:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.559920:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4af04 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.559936:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4af04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.559946:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4af04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.560053:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185aa100) 00010000:00010000:3.0:1777580312.560057:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.560063:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.560070:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4aed3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560177:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560184:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560190:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560196:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.560199:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560205:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560226:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.560228:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.560232:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560238:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4aef6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.560250:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d230860c reply state 000000009ff9d639 transno 8589950713 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.560258:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.560302:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4aeef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e580 expref: 346 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560317:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4af04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e580 expref: 345 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.560324:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.560327:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.560329:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee9400, rc 0) 00000100:00100000:2.0:1777580312.560396:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+346:283063:x1863919946653952:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4112us (4827us total) trans 8589950713 rc 0/0 00000100:00100000:2.0:1777580312.560415:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19479 00000100:00100000:2.0:1777580312.560423:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833498320249 time 7833505136813 state 0x2 ref 0 00000100:00100000:2.0:1777580312.562743:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.564336:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946654208 00000100:00100000:3.0:1777580312.564349:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946654208 00000100:00100000:3.0:1777580312.564395:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833473636940 time 7833491474010 state 0x0 ref 1 00000100:00100000:3.0:1777580312.564420:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833491574010 time 7833491474010 state 0x1 ref 1 00000100:00100000:3.0:1777580312.564467:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833491574010 time 7833513321846 state 0x0 ref 1 00000100:00100000:3.0:1777580312.564487:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+67:283029:x1863919946654208:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580312.564549:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580312.564579:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4a7b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e41b expref: 67 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564617:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4a51e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e365 expref: 66 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564645:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:3.0:1777580312.564667:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580312.564693:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564728:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564743:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564765:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.564775:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.565192:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.565357:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.565369:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.565378:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580312.567271:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1864, 64 off127488 00010000:00010000:3.0:1777580312.567344:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567359:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567369:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567387:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567393:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567399:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.567442:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.567464:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.567478:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.567489:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.567494:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.567504:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.567522:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580312.567525:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.567530:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.567556:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4af27 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.567572:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.567573:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.567575:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.568271:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.568326:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946654336 00000100:00100000:2.0:1777580312.568334:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.568340:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946654336 00010000:00010000:3.0:1777580312.568384:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.568393:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833498320249 time 7833505136813 state 0x0 ref 1 00010000:00010000:3.0:1777580312.568400:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.568410:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833505236813 time 7833505136813 state 0x1 ref 1 00000100:00100000:1.0:1777580312.568449:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833505236813 time 7833517311565 state 0x0 ref 1 00000100:00100000:1.0:1777580312.568464:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+346:283059:x1863919946654336:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.568494:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.568514:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4af2e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e587 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.568583:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4af2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e587 expref: 347 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.568596:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4af2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e587 expref: 347 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.568618:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993df500) 00010000:00010000:1.0:1777580312.568621:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580312.568631:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f200, rc 0) 00000100:00100000:1.0:1777580312.568707:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+347:283059:x1863919946654336:12345-192.168.202.9@tcp:101:touch.500 Request processed in 248us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.568716:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19481 00000100:00100000:1.0:1777580312.568722:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833505236813 time 7833517311565 state 0x2 ref 0 00010000:00010000:3.0:1777580312.569344:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569350:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.569355:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569362:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569375:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x80f:0x0].0x0 (ffffa024993df600) 00010000:00010000:3.0:1777580312.569378:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580312.569382:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569414:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4af20 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569445:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569452:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569542:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569550:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.569553:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569559:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569568:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.569570:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.569573:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569579:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4af12 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580312.569590:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000056870c91 reply state 0000000021615acf transno 8589950714 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.569599:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580312.569704:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+67:283029:x1863919946654208:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5223us (6968us total) trans 8589950714 rc 0/0 00000100:00100000:3.0:1777580312.569714:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19480 00000100:00100000:3.0:1777580312.569722:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833491574010 time 7833513321846 state 0x2 ref 0 00010000:00010000:3.0:1777580312.569776:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569795:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569808:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569814:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.569817:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569823:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569841:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993df500) 00010000:00010000:3.0:1777580312.569844:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.569847:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.569852:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4aee8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.571494:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.571520:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.571904:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946654848 00000100:00100000:3.0:1777580312.571914:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946654848 00000100:00100000:3.0:1777580312.571951:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833505236813 time 7833517311565 state 0x0 ref 1 00000100:00100000:3.0:1777580312.571977:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833517411565 time 7833517311565 state 0x1 ref 1 00000100:00100000:3.0:1777580312.572120:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946655104 00000100:00100000:3.0:1777580312.572124:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946655104 00000100:00100000:3.0:1777580312.572159:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833517411565 time 7833517311565 state 0x1 ref 2 00000100:00100000:2.0:1777580312.572536:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833521496819 time 7833521396819 state 0x1 ref 2 00000100:00100000:2.0:1777580312.572555:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+347:283063:x1863919946654848:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580312.572616:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.573079:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4af04 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e580 expref: 347 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.573100:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.573111:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.573206:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.573219:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.573230:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.573360:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e948eb4 reply state 000000008eff2473 transno 8589950715 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.573368:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.573544:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946654592 00000100:00100000:0.0:1777580312.573557:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946654592 00000100:00100000:0.0:1777580312.573630:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4175 00000100:00100000:0.0:1777580312.573641:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283057:x1863919946654592:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580312.573762:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833521496819 time 7833522621925 state 0x0 ref 2 00000100:00100000:3.0:1777580312.573780:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283067:x1863919946655104:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.573923:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.573940:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4af3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e58e expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.574035:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283057:x1863919946654592:12345-192.168.202.9@tcp:35:touch.500 Request processed in 394us (5704us total) trans 8589950716 rc 0/0 00000100:00100000:0.0:1777580312.574044:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4175 00000100:00100000:2.0:1777580312.574164:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+350:283063:x1863919946654848:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1611us (2673us total) trans 8589950715 rc 0/0 00000100:00100000:2.0:1777580312.574177:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19482 00000100:00100000:2.0:1777580312.574343:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580312.575273:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575286:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575293:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575299:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.575303:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575310:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575323:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0248e788000) 00010000:00010000:2.0:1777580312.575326:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.575331:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.575337:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4aefd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576053:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576069:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576083:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576103:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576112:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.576122:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580312.577327:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15af:0x0], index 1: 0 00010000:00010000:3.0:1777580312.578235:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4af51 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578251:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4af51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578261:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4af51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578296:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578303:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578310:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578315:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.578319:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578324:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578333:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580312.578336:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.578340:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578358:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4af43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580312.578372:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000006082baf reply state 0000000084c8a09e transno 8589950717 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.578381:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580312.578425:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4af3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e58e expref: 350 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578442:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4af51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e58e expref: 349 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.578449:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580312.578452:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580312.578454:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8800, rc 0) 00000100:00100000:2.0:1777580312.584264:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580312.585214:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585227:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585238:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585261:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.585268:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585277:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585297:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580312.585301:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.585308:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.585316:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4af35 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.587684:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946655488 00000100:00100000:2.0:1777580312.587699:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946655488 00000100:00100000:2.0:1777580312.587750:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833491574010 time 7833513321846 state 0x0 ref 1 00000100:00100000:2.0:1777580312.587766:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833513421846 time 7833513321846 state 0x1 ref 1 00000100:00100000:2.0:1777580312.587837:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833513421846 time 7833536688830 state 0x0 ref 1 00000100:00100000:2.0:1777580312.587857:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+67:283035:x1863919946655488:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.587919:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.587951:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4a732 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e40d expref: 67 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.587995:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4a652 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x815:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3b9 expref: 66 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588031:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580312.588051:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.588079:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588094:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588108:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588126:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588156:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588166:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588285:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588293:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.588301:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.589292:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1865, 64 off127552 00010000:00010000:2.0:1777580312.589345:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.589360:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.589369:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.589376:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.589383:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.589389:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590059:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.590083:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590091:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590097:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590102:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.590107:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590114:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590156:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa0248e788300) 00010000:00010000:2.0:1777580312.590159:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.590163:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590169:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638f400/0xcb2b2f2f7e4af6d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590189:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590196:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590202:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590207:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.590210:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590216:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590223:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.590225:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.590228:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.590234:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4af5f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.590253:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000032c96f5e reply state 00000000287773d5 transno 8589950718 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.590261:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.590330:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+67:283035:x1863919946655488:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2481us (6077us total) trans 8589950718 rc 0/0 00000100:00100000:2.0:1777580312.590339:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19484 00000100:00100000:2.0:1777580312.590345:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833513421846 time 7833536688830 state 0x2 ref 0 00010000:00010000:1.0:1777580312.592474:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.592495:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.592509:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.592514:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.592526:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.592546:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x815:0x0].0x0 (ffffa0248e788300) 00010000:00010000:1.0:1777580312.592550:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.592554:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.592561:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4af74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.592595:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.592598:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.592600:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580312.592632:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946655232 00000100:00100000:1.0:1777580312.592644:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946655232 00000100:00100000:1.0:1777580312.592739:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11927 00000100:00100000:1.0:1777580312.592750:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2364:x1863919946655232:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580312.593226:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2364:x1863919946655232:12345-192.168.202.9@tcp:2:touch.500 Request processed in 476us (18881us total) trans 8589938607 rc 0/0 00000100:00100000:1.0:1777580312.593236:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11927 00000100:00100000:3.0:1777580312.593327:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283067:x1863919946655104:12345-192.168.202.9@tcp:101:touch.500 Request processed in 19544us (21796us total) trans 8589950717 rc 0/0 00000100:00100000:3.0:1777580312.593339:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19483 00000100:00100000:3.0:1777580312.593347:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833521496819 time 7833522621925 state 0x2 ref 0 00010000:00010000:3.0:1777580312.595258:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595272:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595279:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595306:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.595311:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595318:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595336:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024993df900) 00010000:00010000:3.0:1777580312.595339:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.595343:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595350:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4af19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.595425:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.595626:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946655616 00000100:00100000:3.0:1777580312.595646:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946655616 00000100:00100000:3.0:1777580312.595683:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833521496819 time 7833522621925 state 0x0 ref 1 00000100:00100000:3.0:1777580312.595696:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833522721925 time 7833522621925 state 0x1 ref 1 00000100:00100000:3.0:1777580312.595802:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833522721925 time 7833544663151 state 0x0 ref 1 00000100:00100000:3.0:1777580312.595819:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283063:x1863919946655616:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.595853:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.595870:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4af7b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e595 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595919:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4af7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e595 expref: 350 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595935:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4af7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e595 expref: 350 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.595949:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa024993df600) 00010000:00010000:3.0:1777580312.595951:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.595952:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9200, rc 0) 00000100:00100000:3.0:1777580312.623475:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+350:283063:x1863919946655616:12345-192.168.202.9@tcp:101:touch.500 Request processed in 27559us (27955us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.623491:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19485 00000100:00100000:3.0:1777580312.623502:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833522721925 time 7833544663151 state 0x2 ref 0 00000100:00100000:1.0:1777580312.626291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.626336:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946655872 00010000:00010000:2.0:1777580312.626479:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626494:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626503:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626509:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.626515:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626523:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626542:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0248e788c00) 00010000:00010000:2.0:1777580312.626545:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.626550:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.626578:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4af66 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.628265:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946655872 00000100:00100000:1.0:1777580312.628332:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833513421846 time 7833536688830 state 0x0 ref 1 00000100:00100000:1.0:1777580312.628348:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833536788830 time 7833536688830 state 0x1 ref 1 00000100:00100000:1.0:1777580312.628397:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833536788830 time 7833577259243 state 0x0 ref 1 00000100:00100000:1.0:1777580312.628413:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+65:283034:x1863919946655872:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580312.628494:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580312.628527:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4a820 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e429 expref: 65 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628553:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4a5f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x813:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e39d expref: 64 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628564:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa02499549a00) 00010000:00010000:1.0:1777580312.628574:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.628604:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628620:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628648:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628668:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628675:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628682:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628843:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628852:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.628859:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580312.629481:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1866, 64 off127616 00010000:00010000:1.0:1777580312.629555:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629567:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629575:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629583:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629596:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629602:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629630:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580312.629655:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629661:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629667:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629673:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.629677:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629685:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629696:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa024185aa600) 00010000:00010000:1.0:1777580312.629699:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580312.629703:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629935:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4af90 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629970:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629977:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629984:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629989:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.629992:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.629999:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.630007:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.630011:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.630014:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.630020:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4af82 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.630032:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b70c0877 reply state 00000000278432b4 transno 8589950719 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.630042:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.630202:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.630210:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.630217:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.630220:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.630227:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.630237:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x813:0x0].0x0 (ffffa024185aa600) 00010000:00010000:2.0:1777580312.630240:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.630243:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.630249:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4af97 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.630265:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.630267:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.630268:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580312.630589:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+65:283034:x1863919946655872:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2176us (4308us total) trans 8589950719 rc 0/0 00000100:00100000:1.0:1777580312.630600:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19486 00000100:00100000:1.0:1777580312.630617:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833536788830 time 7833577259243 state 0x2 ref 0 00000100:00100000:1.0:1777580312.630723:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.631212:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.631244:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946656384 00000100:00100000:1.0:1777580312.631253:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946656384 00000100:00100000:1.0:1777580312.631302:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4176 00000100:00100000:1.0:1777580312.631312:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+350:283059:x1863919946656384:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580312.635431:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283059:x1863919946656384:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4100us (4199us total) trans 8589950720 rc 0/0 00000100:00100000:1.0:1777580312.635450:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4176 00000100:00100000:1.0:1777580312.635520:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946656128 00000100:00100000:1.0:1777580312.635531:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946656128 00000100:00100000:1.0:1777580312.635572:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833522721925 time 7833544663151 state 0x0 ref 1 00000100:00100000:1.0:1777580312.635585:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833544763151 time 7833544663151 state 0x1 ref 1 00000100:00100000:1.0:1777580312.635612:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833544763151 time 7833584475048 state 0x0 ref 1 00000100:00100000:1.0:1777580312.635624:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283067:x1863919946656128:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580312.635691:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580312.635724:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4af51 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e58e expref: 351 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.635748:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:1.0:1777580312.635761:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.635876:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.635908:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.635920:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.636095:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000082c1715e reply state 00000000dfab2c3d transno 8589950721 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.636106:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.641366:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.641445:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580312.641768:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+352:283067:x1863919946656128:12345-192.168.202.9@tcp:36:touch.500 Request processed in 6141us (11041us total) trans 8589950721 rc 0/0 00000100:00100000:1.0:1777580312.641784:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19487 00000100:00100000:1.0:1777580312.641874:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833544763151 time 7833584475048 state 0x2 ref 0 00000100:00100000:1.0:1777580312.641935:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946656640 00000100:00100000:1.0:1777580312.641947:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946656640 00000100:00100000:1.0:1777580312.641982:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833544763151 time 7833584475048 state 0x0 ref 1 00000100:00100000:1.0:1777580312.641995:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833584575048 time 7833584475048 state 0x1 ref 1 00000100:00100000:1.0:1777580312.642019:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833584575048 time 7833590881418 state 0x0 ref 1 00000100:00100000:1.0:1777580312.642030:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+352:283082:x1863919946656640:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.642057:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.642083:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4afa5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e59c expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642376:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642396:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642409:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642428:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642436:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.642443:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.642955:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946656768 00000100:00100000:0.0:1777580312.642963:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946656768 00000100:00100000:0.0:1777580312.643016:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11928 00000100:00100000:0.0:1777580312.643026:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2363:x1863919946656768:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.643459:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2363:x1863919946656768:12345-192.168.202.9@tcp:2:touch.500 Request processed in 433us (2011us total) trans 8589939010 rc 0/0 00000100:00100000:0.0:1777580312.643467:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11928 00000004:00080000:1.0:1777580312.646236:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d4:0x0], index 0: 0 00010000:00010000:1.0:1777580312.646567:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4afba lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646588:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4afba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646603:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4afba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646652:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646677:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646684:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646690:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.646695:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646702:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646716:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580312.646719:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.646725:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.646731:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4afac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.646747:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d128aab3 reply state 00000000a35b8ea5 transno 8589950722 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.646757:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580312.647325:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4afa5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e59c expref: 355 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.647349:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4afba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e59c expref: 354 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.647377:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580312.647380:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580312.647383:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838800, rc 0) 00000100:00100000:1.0:1777580312.653113:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+355:283082:x1863919946656640:12345-192.168.202.9@tcp:101:touch.500 Request processed in 11061us (11737us total) trans 8589950722 rc 0/0 00000100:00100000:1.0:1777580312.653131:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19488 00000100:00100000:1.0:1777580312.653158:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833584575048 time 7833590881418 state 0x2 ref 0 00010000:00010000:3.0:1777580312.653441:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653454:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653462:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653468:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.653474:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653482:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653502:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024993df300) 00010000:00010000:3.0:1777580312.653527:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.653534:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.653540:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4af4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.657701:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.657738:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946657024 00000100:00100000:2.0:1777580312.657751:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946657024 00000100:00100000:2.0:1777580312.657834:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833536788830 time 7833577259243 state 0x0 ref 1 00000100:00100000:2.0:1777580312.657850:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833577359243 time 7833577259243 state 0x1 ref 1 00000100:00100000:2.0:1777580312.657890:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833577359243 time 7833606751275 state 0x0 ref 1 00000100:00100000:2.0:1777580312.657904:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+65:283032:x1863919946657024:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.657979:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.658013:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4a804 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e422 expref: 65 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658040:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4a5bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x812:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e396 expref: 64 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658054:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa02499549300) 00010000:00010000:2.0:1777580312.658067:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.658096:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658113:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658124:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658176:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658185:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658203:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658607:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658617:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.658625:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659460:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659471:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659479:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659486:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.659492:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659501:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659516:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024185aa100) 00010000:00010000:3.0:1777580312.659519:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.659523:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.659530:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4af89 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.659696:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1868, 64 off127744 00010000:00010000:2.0:1777580312.659778:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.659792:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660368:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660380:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660386:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660392:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660449:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.660498:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660505:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660510:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660515:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.660519:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660526:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660538:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580312.660540:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.660544:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660551:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4afd6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660573:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660579:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660585:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660601:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.660604:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660610:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660619:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.660621:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.660624:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.660629:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4afc8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.660640:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c706ffbd reply state 00000000cf1ad78c transno 8589950723 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.660649:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.660754:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+64:283032:x1863919946657024:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2848us (3063us total) trans 8589950723 rc 0/0 00000100:00100000:2.0:1777580312.660766:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19489 00000100:00100000:2.0:1777580312.660776:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833577359243 time 7833606751275 state 0x2 ref 0 00010000:00010000:2.0:1777580312.661931:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.661945:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.661969:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.661974:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.661979:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.661985:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.662000:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa024185aa500) 00010000:00010000:2.0:1777580312.662003:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.662007:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.662013:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4af9e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.670887:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.670920:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.670931:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.670936:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.670947:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.670969:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x812:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580312.670972:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.670977:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.670984:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4afdd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.671008:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.671011:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.671013:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580312.671204:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.671231:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.671278:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946657280 00000100:00100000:2.0:1777580312.671289:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946657280 00000100:00100000:2.0:1777580312.671335:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833584575048 time 7833590881418 state 0x0 ref 1 00000100:00100000:2.0:1777580312.671348:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833590981418 time 7833590881418 state 0x1 ref 1 00000100:00100000:2.0:1777580312.671371:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946657536 00000100:00100000:2.0:1777580312.671374:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946657536 00000100:00100000:2.0:1777580312.671389:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833590981418 time 7833590881418 state 0x1 ref 2 00000100:00100000:2.0:1777580312.671412:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620374390 time 7833620274390 state 0x1 ref 2 00000100:00100000:2.0:1777580312.671433:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+354:283082:x1863919946657280:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580312.671502:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580312.671525:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4afba lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e59c expref: 354 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.671540:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:2.0:1777580312.671549:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.671642:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.671659:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.671670:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.671857:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000056ff3548 reply state 00000000c0a28f24 transno 8589950724 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.671869:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.671975:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+355:283082:x1863919946657280:12345-192.168.202.9@tcp:36:touch.500 Request processed in 544us (776us total) trans 8589950724 rc 0/0 00000100:00100000:2.0:1777580312.671984:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19490 00000100:00100000:2.0:1777580312.672007:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620374390 time 7833620870230 state 0x0 ref 1 00000100:00100000:2.0:1777580312.672017:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+354:283069:x1863919946657536:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.672028:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.672047:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4afeb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5a3 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672194:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672206:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672215:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672226:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672234:0:188495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672243:0:188495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672260:0:188495:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672270:0:188495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.672466:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.672489:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946657664 00000100:00100000:2.0:1777580312.672495:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946657664 00000100:00100000:2.0:1777580312.672515:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620970230 time 7833620870230 state 0x1 ref 2 00000100:00100000:2.0:1777580312.672534:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620970230 time 7833621397741 state 0x0 ref 2 00000100:00100000:2.0:1777580312.672550:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248ba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+356:283067:x1863919946657664:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.672561:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.672574:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4b000 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5aa expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672609:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4b000 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5aa expref: 357 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672622:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4b000 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5aa expref: 357 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672641:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.672645:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580312.672648:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd000, rc 0) 00000100:00100000:2.0:1777580312.672678:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248ba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+357:283067:x1863919946657664:12345-192.168.202.9@tcp:101:touch.500 Request processed in 128us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.672684:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19492 00010000:00010000:2.0:1777580312.672737:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672746:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672753:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672760:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.672763:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672777:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672788:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa0248e788c00) 00010000:00010000:2.0:1777580312.672791:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.672793:0:3275:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672802:0:3275:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672808:0:3275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672841:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672848:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4afcf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672871:0:188495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.672878:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580312.673419:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b0:0x0], index 1: 0 00010000:00010000:2.0:1777580312.673592:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4b007 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673603:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4b007 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673623:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4b007 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673663:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673671:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673678:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673683:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.673686:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673694:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673704:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.673706:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.673710:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673717:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4aff2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.673728:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000064c9be10 reply state 00000000a6d70a90 transno 8589950725 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.673736:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.673775:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4afeb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5a3 expref: 358 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673788:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4b007 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5a3 expref: 357 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.673797:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa0248e788200) 00010000:00010000:2.0:1777580312.673799:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.673802:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fda00, rc 0) 00000100:00100000:2.0:1777580312.673872:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283069:x1863919946657536:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1855us (2639us total) trans 8589950725 rc 0/0 00000100:00100000:2.0:1777580312.673881:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19491 00000100:00100000:2.0:1777580312.673887:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620970230 time 7833621397741 state 0x2 ref 0 00010000:00010000:3.0:1777580312.674546:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674557:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674564:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674570:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.674573:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674591:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674604:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024185aa400) 00010000:00010000:3.0:1777580312.674607:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.674610:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.674616:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4afb3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.677102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.677182:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.677225:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946658176 00000100:00100000:2.0:1777580312.677238:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946658176 00000100:00100000:2.0:1777580312.677508:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833577359243 time 7833606751275 state 0x0 ref 1 00000100:00100000:2.0:1777580312.677525:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833606851275 time 7833606751275 state 0x1 ref 1 00000100:00100000:2.0:1777580312.677554:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833606851275 time 7833626416629 state 0x0 ref 1 00000100:00100000:2.0:1777580312.677568:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248ba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283036:x1863919946658176:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.677648:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.677682:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4ac09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4c3 expref: 63 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677731:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4a675 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x816:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3c7 expref: 62 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677744:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:2.0:1777580312.677756:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.677784:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677915:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677930:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677953:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677961:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.677967:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.678119:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.678127:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.678207:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.679061:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946657920 00000100:00100000:1.0:1777580312.679072:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946657920 00000100:00100000:1.0:1777580312.683154:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4177 00000100:00100000:1.0:1777580312.683206:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+357:283063:x1863919946657920:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580312.683758:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283063:x1863919946657920:12345-192.168.202.9@tcp:35:touch.500 Request processed in 580us (6571us total) trans 8589950726 rc 0/0 00000100:00100000:1.0:1777580312.683769:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4177 00000040:00080000:2.0:1777580312.684770:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1869, 64 off127808 00010000:00010000:2.0:1777580312.684968:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.684990:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685005:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685014:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685021:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685028:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685057:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.685084:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685090:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685096:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685102:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.685107:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685129:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685175:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa0248e788600) 00010000:00010000:2.0:1777580312.685178:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.685183:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685190:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b023 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685211:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685218:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685225:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685229:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.685232:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685238:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685316:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.685320:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.685323:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.685340:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4b015 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.685352:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000086ed4815 reply state 000000003862a558 transno 8589950727 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.685362:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.685464:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248ba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283036:x1863919946658176:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7894us (8370us total) trans 8589950727 rc 0/0 00000100:00100000:2.0:1777580312.685475:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19493 00000100:00100000:2.0:1777580312.685485:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833606851275 time 7833626416629 state 0x2 ref 0 00010000:00010000:3.0:1777580312.685724:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.685732:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.685739:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.685742:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.685749:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.685760:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x816:0x0].0x0 (ffffa0248e788600) 00010000:00010000:3.0:1777580312.685762:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.685765:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.685772:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b02a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.685790:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.685812:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.685814:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.695311:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.695423:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580312.695461:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695474:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695483:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695489:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.695495:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695502:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695522:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa0248e788000) 00010000:00010000:3.0:1777580312.695525:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.695530:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.695537:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8600/0xcb2b2f2f7e4afe4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.695885:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946658304 00000100:00100000:1.0:1777580312.695898:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946658304 00000100:00100000:1.0:1777580312.695946:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833620970230 time 7833621397741 state 0x0 ref 1 00000100:00100000:1.0:1777580312.695980:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833621497741 time 7833621397741 state 0x1 ref 1 00000100:00100000:1.0:1777580312.696005:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946658688 00000100:00100000:1.0:1777580312.696008:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946658688 00000100:00100000:1.0:1777580312.696021:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833621497741 time 7833621397741 state 0x1 ref 2 00000100:00100000:1.0:1777580312.696041:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645004275 time 7833644904275 state 0x1 ref 2 00000100:00100000:1.0:1777580312.696074:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283082:x1863919946658304:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580312.696106:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580312.696129:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b031 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5b1 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696232:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b1 expref: 359 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696248:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b031 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b1 expref: 359 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696269:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024185aa400) 00010000:00010000:1.0:1777580312.696271:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580312.696274:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838200, rc 0) 00000100:00100000:1.0:1777580312.696349:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283082:x1863919946658304:12345-192.168.202.9@tcp:101:touch.500 Request processed in 277us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580312.696357:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19494 00000100:00100000:1.0:1777580312.696380:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645004275 time 7833645243833 state 0x0 ref 1 00000100:00100000:1.0:1777580312.696389:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283069:x1863919946658688:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580312.696434:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580312.696452:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4b007 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5a3 expref: 358 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696464:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa0248e788200) 00010000:00010000:1.0:1777580312.696478:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580312.696545:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696553:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.696561:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580312.696727:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000be9027e3 reply state 0000000013b30e4c transno 8589950728 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580312.696737:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580312.696797:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283069:x1863919946658688:12345-192.168.202.9@tcp:36:touch.500 Request processed in 408us (1375us total) trans 8589950728 rc 0/0 00000100:00100000:1.0:1777580312.696804:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19495 00000100:00100000:1.0:1777580312.696809:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645004275 time 7833645243833 state 0x2 ref 0 00010000:00010000:2.0:1777580312.708424:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708447:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708455:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708461:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.708467:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708475:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708496:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa0248e788c00) 00010000:00010000:2.0:1777580312.708500:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.708526:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.708533:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4aff9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.708661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.708821:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.708869:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946659200 00000100:00100000:2.0:1777580312.708881:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946659200 00000100:00100000:2.0:1777580312.708926:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833606851275 time 7833626416629 state 0x0 ref 1 00000100:00100000:2.0:1777580312.708940:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833626516629 time 7833626416629 state 0x1 ref 1 00000100:00100000:2.0:1777580312.708966:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833626516629 time 7833657827531 state 0x0 ref 1 00000100:00100000:2.0:1777580312.708979:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283039:x1863919946659200:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.709058:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.709081:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4ac56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d8 expref: 63 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709100:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4a7b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x818:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e445 expref: 62 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709109:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580312.709118:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.709174:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709189:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709211:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709226:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709234:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709240:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709405:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709413:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.709420:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.709995:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1870, 64 off127872 00010000:00010000:2.0:1777580312.710075:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710087:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710096:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710104:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710119:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710126:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710182:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.710207:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710214:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710221:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710226:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.710231:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710238:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710249:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580312.710252:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.710256:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710263:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4b04d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710291:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710297:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710303:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710308:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.710311:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710317:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710325:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.710328:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.710331:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.710337:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4b03f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.710347:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003386d07b reply state 0000000044815f62 transno 8589950729 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.710355:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.710460:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283039:x1863919946659200:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1480us (1636us total) trans 8589950729 rc 0/0 00000100:00100000:2.0:1777580312.710470:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19496 00000100:00100000:2.0:1777580312.710482:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833626516629 time 7833657827531 state 0x2 ref 0 00010000:00010000:0.0:1777580312.711364:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580312.711375:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.711397:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580312.711401:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.711408:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.711423:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x818:0x0].0x0 (ffffa0248e788100) 00010000:00010000:0.0:1777580312.711426:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580312.711430:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.711436:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4b054 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.711462:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.711464:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580312.711465:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.711486:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946658432 00000100:00100000:0.0:1777580312.711496:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946658432 00000100:00100000:0.0:1777580312.711561:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11929 00000100:00100000:0.0:1777580312.711573:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2364:x1863919946658432:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.712063:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2364:x1863919946658432:12345-192.168.202.9@tcp:2:touch.500 Request processed in 490us (3406us total) trans 8589938608 rc 0/0 00000100:00100000:0.0:1777580312.712072:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11929 00010000:00010000:3.0:1777580312.716354:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716378:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716394:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716402:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.716409:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716418:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716438:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0248e788b00) 00010000:00010000:3.0:1777580312.716441:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.716447:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.716454:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4b01c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.717446:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.717491:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946658944 00000100:00100000:2.0:1777580312.717506:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946658944 00000100:00100000:2.0:1777580312.717555:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833626516629 time 7833657827531 state 0x0 ref 1 00000100:00100000:2.0:1777580312.717570:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833657927531 time 7833657827531 state 0x1 ref 1 00000100:00100000:2.0:1777580312.717599:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833657927531 time 7833666460799 state 0x0 ref 1 00000100:00100000:2.0:1777580312.717611:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283064:x1863919946658944:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.717703:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.717731:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4adc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e52c expref: 358 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.717752:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4acdb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e510 expref: 357 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.717762:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa02427669d00) 00010000:00010000:2.0:1777580312.717771:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.718333:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718352:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718364:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718394:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718400:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718406:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718562:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718571:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.718578:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.728613:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1867, 64 off127680 00010000:00010000:2.0:1777580312.728721:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728744:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728759:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728768:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728775:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728791:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728843:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.728874:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728881:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728888:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728894:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.728899:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728906:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728921:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580312.728925:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.728929:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728936:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b069 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728961:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728978:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728985:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.728991:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.728994:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.729000:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.729009:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.729012:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.729015:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.729021:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9800/0xcb2b2f2f7e4b05b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.729032:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008d7b90f6 reply state 00000000b9e57bdc transno 8589950730 ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.729041:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.729187:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283064:x1863919946658944:12345-192.168.202.9@tcp:36:rm.500 Request processed in 11572us (11744us total) trans 8589950730 rc 0/0 00000100:00100000:2.0:1777580312.729198:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19497 00000100:00100000:2.0:1777580312.729207:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833657927531 time 7833666460799 state 0x2 ref 0 00000100:00100000:2.0:1777580312.729461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.729494:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580312.729569:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.729578:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.729586:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.729590:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.729597:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.729609:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ea:0x0].0x0 (ffffa0248e788800) 00010000:00010000:3.0:1777580312.729618:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.729621:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.729627:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4b070 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.729647:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.729649:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.729650:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580312.730368:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946659328 00000100:00100000:3.0:1777580312.730382:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946659328 00000100:00100000:3.0:1777580312.730429:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645004275 time 7833645243833 state 0x0 ref 1 00000100:00100000:3.0:1777580312.730442:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645343833 time 7833645243833 state 0x1 ref 1 00000100:00100000:3.0:1777580312.730472:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645343833 time 7833679333486 state 0x0 ref 1 00000100:00100000:3.0:1777580312.730487:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283069:x1863919946659328:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.730513:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.730535:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b077 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5b8 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.730604:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b077 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b8 expref: 359 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.730619:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b077 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b8 expref: 359 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.730638:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa500) 00010000:00010000:3.0:1777580312.730655:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.730659:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9800, rc 0) 00000100:00100000:3.0:1777580312.730729:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283069:x1863919946659328:12345-192.168.202.9@tcp:101:touch.500 Request processed in 247us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.730737:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19498 00000100:00100000:3.0:1777580312.730742:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645343833 time 7833679333486 state 0x2 ref 0 00000100:00100000:2.0:1777580312.734622:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.734750:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.734788:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946659968 00000100:00100000:2.0:1777580312.734807:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946659968 00000100:00100000:2.0:1777580312.734867:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833657927531 time 7833666460799 state 0x0 ref 1 00000100:00100000:2.0:1777580312.734883:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833666560799 time 7833666460799 state 0x1 ref 1 00000100:00100000:2.0:1777580312.734911:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833666560799 time 7833683773427 state 0x0 ref 1 00000100:00100000:2.0:1777580312.734924:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283060:x1863919946659968:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.735000:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.735034:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4ade5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e533 expref: 359 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735056:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4ac1e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4d1 expref: 358 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735070:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa024814ca600) 00010000:00010000:2.0:1777580312.735080:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.735110:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735127:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735170:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735199:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735205:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735212:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735368:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735377:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.735384:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.735965:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1868, 64 off127744 00010000:00010000:2.0:1777580312.736043:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736054:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736065:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736073:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736079:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736092:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736119:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.736168:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736175:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736181:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736187:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.736192:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736199:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736209:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580312.736212:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.736216:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736223:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4b08c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736241:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736256:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736263:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736268:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.736271:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736277:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736285:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.736288:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.736291:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736296:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4b07e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.736308:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007e8346bc reply state 000000005b6817e7 transno 8589950731 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.736317:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.736424:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283060:x1863919946659968:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1498us (1670us total) trans 8589950731 rc 0/0 00000100:00100000:2.0:1777580312.736435:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19499 00000100:00100000:2.0:1777580312.736442:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833666560799 time 7833683773427 state 0x2 ref 0 00010000:00010000:2.0:1777580312.736509:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580312.736516:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736523:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580312.736527:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736534:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736543:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e8:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580312.736545:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580312.736548:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736553:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4b093 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736567:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.736568:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.736570:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.736584:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736590:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736596:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736601:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.736610:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736616:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736624:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0248e788300) 00010000:00010000:2.0:1777580312.736626:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.736628:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736634:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4b062 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736654:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736659:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736665:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736669:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.736671:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736676:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736683:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa500) 00010000:00010000:2.0:1777580312.736685:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.736692:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.736699:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b038 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737336:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737348:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737354:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737359:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.737362:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737369:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737380:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0248e788e00) 00010000:00010000:3.0:1777580312.737383:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.737385:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.737391:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4b046 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.738400:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.738508:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946659456 00000100:00100000:0.0:1777580312.738521:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946659456 00000100:00100000:0.0:1777580312.738585:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946660096 00000100:00100000:0.0:1777580312.738598:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946660096 00000100:00100000:0.0:1777580312.740296:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11930 00000100:00100000:0.0:1777580312.740319:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2361:x1863919946659456:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.740729:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2361:x1863919946659456:12345-192.168.202.9@tcp:2:touch.500 Request processed in 420us (11233us total) trans 8589939011 rc 0/0 00000100:00100000:0.0:1777580312.740738:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11930 00000100:00100000:0.0:1777580312.740760:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11931 00000100:00100000:0.0:1777580312.740768:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2363:x1863919946660096:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.740950:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2363:x1863919946660096:12345-192.168.202.9@tcp:2:touch.500 Request processed in 182us (2559us total) trans 8589938609 rc 0/0 00000100:00100000:0.0:1777580312.740957:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11931 00000100:00100000:2.0:1777580312.744663:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.744900:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946660352 00000100:00100000:2.0:1777580312.744911:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946660352 00000100:00100000:2.0:1777580312.744958:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833666560799 time 7833683773427 state 0x0 ref 1 00000100:00100000:2.0:1777580312.744972:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833683873427 time 7833683773427 state 0x1 ref 1 00000100:00100000:2.0:1777580312.744996:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833683873427 time 7833693859073 state 0x0 ref 1 00000100:00100000:2.0:1777580312.745007:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+357:283061:x1863919946660352:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.745079:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.745116:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ae2b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e53a expref: 357 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745216:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4ac5d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ed expref: 356 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745231:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580312.745297:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.745327:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745343:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745371:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745389:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745396:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745402:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745559:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745567:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.745573:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.745964:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946659712 00000100:00100000:0.0:1777580312.745972:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946659712 00000100:00100000:0.0:1777580312.746022:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4178 00000100:00100000:0.0:1777580312.746031:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+356:283067:x1863919946659712:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580312.746423:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+357:283067:x1863919946659712:12345-192.168.202.9@tcp:35:touch.500 Request processed in 392us (11814us total) trans 8589950732 rc 0/0 00000100:00100000:0.0:1777580312.746431:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4178 00010000:00010000:3.0:1777580312.749050:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749070:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749079:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749086:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.749091:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749100:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749122:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0248e788c00) 00010000:00010000:3.0:1777580312.749125:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.749131:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.749151:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4b085 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.749532:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1871, 64 off127936 00010000:00010000:2.0:1777580312.749634:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749651:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749664:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749672:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749692:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749698:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749728:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.749762:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749768:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749775:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749780:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.749784:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.749790:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.751104:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580312.751117:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.751127:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580312.751131:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.752393:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.752497:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa02427669600) 00010000:00010000:3.0:1777580312.752501:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580312.752508:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.752515:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4b0af lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.752536:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.752539:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580312.752541:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580312.752632:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e9:0x0].0x0 (ffffa02427669600) 00010000:00010000:2.0:1777580312.752635:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.752638:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752646:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4b0a8 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752696:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752704:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752709:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752715:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.752718:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752724:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752733:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.752735:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.752738:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.752744:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4b09a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.752757:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bcffa061 reply state 0000000059a55578 transno 8589950733 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.752767:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.754448:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+357:283061:x1863919946660352:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9426us (9782us total) trans 8589950733 rc 0/0 00000100:00100000:2.0:1777580312.754463:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19500 00000100:00100000:2.0:1777580312.754484:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833683873427 time 7833693859073 state 0x2 ref 0 00000100:00100000:2.0:1777580312.754598:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.755464:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946660608 00000100:00100000:3.0:1777580312.755476:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946660608 00000100:00100000:2.0:1777580312.756051:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.756938:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946660864 00000100:00100000:0.0:1777580312.756949:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946660864 00000100:00100000:0.0:1777580312.757007:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4179 00000100:00100000:0.0:1777580312.757018:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283082:x1863919946660864:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580312.757461:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283082:x1863919946660864:12345-192.168.202.9@tcp:35:touch.500 Request processed in 443us (1414us total) trans 8589950734 rc 0/0 00000100:00100000:0.0:1777580312.757488:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4179 00000100:00100000:3.0:1777580312.766123:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4180 00000100:00100000:3.0:1777580312.766166:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283069:x1863919946660608:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580312.766633:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283069:x1863919946660608:12345-192.168.202.9@tcp:35:touch.500 Request processed in 481us (12034us total) trans 8589950735 rc 0/0 00000100:00100000:3.0:1777580312.766643:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4180 00010000:00010000:2.0:1777580312.789085:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789108:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789116:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789123:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.789128:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789164:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789185:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580312.789189:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.789194:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.789201:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4b0a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.806525:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.806585:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661120 00000100:00100000:2.0:1777580312.806598:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661120 00000100:00100000:2.0:1777580312.806650:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833683873427 time 7833693859073 state 0x0 ref 1 00000100:00100000:2.0:1777580312.806675:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833693959073 time 7833693859073 state 0x1 ref 1 00000100:00100000:2.0:1777580312.806709:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833693959073 time 7833755571086 state 0x0 ref 1 00000100:00100000:2.0:1777580312.806722:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283055:x1863919946661120:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580312.807469:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580312.807509:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4ae16 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e541 expref: 358 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807543:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4ab8b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4ae expref: 357 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807557:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa02427669200) 00010000:00010000:2.0:1777580312.807573:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580312.807607:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807624:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807636:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807654:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807662:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.807669:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809150:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809171:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809184:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580312.809846:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1872, 64 off128000 00010000:00010000:2.0:1777580312.809932:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809947:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809958:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809967:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809974:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.809981:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810008:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580312.810036:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810057:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810063:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810070:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.810075:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810082:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810096:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa02427669d00) 00010000:00010000:2.0:1777580312.810099:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580312.810104:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810110:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4b0c4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810160:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810167:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810173:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810178:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.810186:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810193:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810202:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.810204:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.810207:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.810214:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4b0b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.810224:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000795a197c reply state 00000000239acf6b transno 8589950736 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.810235:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580312.810361:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+358:283055:x1863919946661120:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3636us (3840us total) trans 8589950736 rc 0/0 00000100:00100000:2.0:1777580312.810372:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19501 00000100:00100000:2.0:1777580312.810381:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833693959073 time 7833755571086 state 0x2 ref 0 00010000:00010000:1.0:1777580312.818514:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580312.818533:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.818546:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580312.818551:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.818561:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.818583:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7e7:0x0].0x0 (ffffa02427669d00) 00010000:00010000:1.0:1777580312.818606:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580312.818612:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.818619:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4b0cb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.818645:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.818647:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580312.818649:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580312.833492:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833522:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833544:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833575:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833596:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833616:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833641:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.833679:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661248 00000100:00100000:0.0:1777580312.833692:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661248 00000100:00100000:0.0:1777580312.833743:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833693959073 time 7833755571086 state 0x0 ref 1 00000100:00100000:0.0:1777580312.833759:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 1 00000100:00100000:0.0:1777580312.833781:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661376 00000100:00100000:0.0:1777580312.833784:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661376 00000100:00100000:0.0:1777580312.833796:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 2 00000100:00100000:0.0:1777580312.833803:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661504 00000100:00100000:0.0:1777580312.833805:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661504 00000100:00100000:0.0:1777580312.833816:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 3 00000100:00100000:0.0:1777580312.833822:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661632 00000100:00100000:0.0:1777580312.833834:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661632 00000100:00100000:0.0:1777580312.833845:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 4 00000100:00100000:0.0:1777580312.833852:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661760 00000100:00100000:0.0:1777580312.833854:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661760 00000100:00100000:0.0:1777580312.833864:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 5 00000100:00100000:0.0:1777580312.833892:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946661888 00000100:00100000:0.0:1777580312.833895:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946661888 00000100:00100000:0.0:1777580312.833906:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 6 00000100:00100000:0.0:1777580312.833912:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662016 00000100:00100000:0.0:1777580312.833914:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662016 00000100:00100000:0.0:1777580312.833924:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833755671086 time 7833755571086 state 0x1 ref 7 00000100:00100000:0.0:1777580312.833936:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833782899590 time 7833782799590 state 0x1 ref 7 00000100:00100000:0.0:1777580312.833947:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283071:x1863919946661248:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.833978:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.834003:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b0d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5bf expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834084:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834100:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834113:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834131:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834162:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.834169:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837103:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837125:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837148:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837156:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.837162:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837170:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837193:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.837196:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.837202:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837209:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b0d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837231:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837237:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837255:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837276:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.837280:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837286:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837295:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02481358000) 00010000:00010000:0.0:1777580312.837298:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.837301:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837307:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b0e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837375:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b0d2 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5bf expref: 365 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837386:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.837388:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.837392:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b0d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5bf expref: 365 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837402:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:0.0:1777580312.837505:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283071:x1863919946661248:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3556us (4026us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580312.837517:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19502 00000100:00100000:0.0:1777580312.837569:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833786529160 time 7833786429160 state 0x1 ref 6 00000100:00100000:0.0:1777580312.837598:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283081:x1863919946661376:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.837619:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.837636:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b0e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5c6 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837702:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837716:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837726:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837744:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837750:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.837757:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.837943:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833786904275 time 7833786804275 state 0x1 ref 6 00000100:00100000:2.0:1777580312.837960:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283086:x1863919946661504:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.837970:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.837980:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b0fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5cd expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838033:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838043:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838052:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838066:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838073:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838081:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838180:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838189:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838197:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.838230:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ed:0x0]: returning size 0 00000004:00200000:2.0:1777580312.838234:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.838267:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838291:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838299:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838306:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838311:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838317:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.838320:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838327:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838337:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.838339:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.838343:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838347:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4b103 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838360:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838366:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838377:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838382:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.838384:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838390:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838398:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580312.838400:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.838403:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838409:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4b10a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838436:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4b0fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5cd expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838450:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5cd expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838457:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993df500) 00010000:00010000:2.0:1777580312.838459:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.838462:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f400, rc 0) 00000100:00100000:2.0:1777580312.838510:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283086:x1863919946661504:12345-192.168.202.9@tcp:101:rm.500 Request processed in 554us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.838526:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19504 00000100:00100000:2.0:1777580312.838557:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833787519547 time 7833787419547 state 0x1 ref 5 00000100:00100000:2.0:1777580312.838568:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283095:x1863919946661632:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.838578:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.838587:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4b118 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5d4 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838620:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838628:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838636:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838649:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838656:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838663:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838724:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838732:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838745:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.838766:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f0:0x0]: returning size 0 00000004:00200000:2.0:1777580312.838769:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.838779:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838788:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838794:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838800:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838806:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838810:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.838813:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838820:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838842:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.838844:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.838848:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838863:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4b11f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838874:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838880:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838886:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838891:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.838893:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838899:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838905:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02488b77800) 00010000:00010000:2.0:1777580312.838907:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.838909:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838915:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4b126 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838935:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4b118 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5d4 expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838957:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5d4 expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.838964:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024185aa400) 00010000:00010000:2.0:1777580312.838966:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.838969:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7000, rc 0) 00000100:00100000:2.0:1777580312.838994:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283095:x1863919946661632:12345-192.168.202.9@tcp:101:rm.500 Request processed in 429us (5419us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.839001:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19505 00000100:00100000:2.0:1777580312.839022:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833787984855 time 7833787884855 state 0x1 ref 4 00000100:00100000:2.0:1777580312.839032:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283096:x1863919946661760:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.839041:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.839049:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b134 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5db expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839077:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839085:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839093:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839103:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839119:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839125:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839205:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839213:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839219:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.839238:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f1:0x0]: returning size 0 00000004:00200000:2.0:1777580312.839241:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.839249:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839256:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839263:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839268:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839274:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839288:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.839292:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839298:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839306:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.839309:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.839311:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839317:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4b13b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839328:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839334:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839340:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839345:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.839348:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839354:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839370:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02488b77500) 00010000:00010000:2.0:1777580312.839373:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.839375:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839381:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4b142 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839404:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b134 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5db expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839416:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5db expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839423:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa500) 00010000:00010000:2.0:1777580312.839425:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.839428:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7800, rc 0) 00000100:00100000:2.0:1777580312.839456:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283096:x1863919946661760:12345-192.168.202.9@tcp:101:rm.500 Request processed in 424us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.839463:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19506 00000100:00100000:2.0:1777580312.839482:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788445030 time 7833788345030 state 0x1 ref 3 00000100:00100000:2.0:1777580312.839493:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283089:x1863919946661888:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.839502:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.839511:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b150 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5e2 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839560:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839569:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839576:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839587:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839594:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839601:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839655:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839664:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839670:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.839690:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ee:0x0]: returning size 0 00000004:00200000:2.0:1777580312.839692:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.839702:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839720:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839728:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839733:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839739:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839745:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.839747:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839753:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839761:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.839763:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.839766:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839771:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b157 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839784:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839789:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839800:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839805:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.839809:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839815:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839839:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02499549300) 00010000:00010000:2.0:1777580312.839842:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.839845:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839851:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b15e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839874:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b150 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e2 expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839885:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e2 expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.839892:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa024993df600) 00010000:00010000:2.0:1777580312.839894:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.839896:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031c00, rc 0) 00000100:00100000:2.0:1777580312.839919:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283089:x1863919946661888:12345-192.168.202.9@tcp:101:rm.500 Request processed in 427us (6301us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.839933:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19507 00000100:00100000:2.0:1777580312.839952:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788445030 time 7833788815300 state 0x0 ref 2 00000100:00100000:2.0:1777580312.839963:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283097:x1863919946662016:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.839972:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.839979:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b16c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5e9 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840024:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840033:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840040:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840050:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840057:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840063:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840114:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840122:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840163:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580312.840183:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ef:0x0]: returning size 0 00000004:00200000:2.0:1777580312.840185:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580312.840194:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840201:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840207:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840212:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840217:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840222:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.840226:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840231:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840238:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.840240:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.840242:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840258:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b173 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840270:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840276:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840281:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840286:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.840289:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840295:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840302:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02499549a00) 00010000:00010000:2.0:1777580312.840305:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.840307:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840313:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b17a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840338:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b16c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e9 expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840360:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e9 expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.840366:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:2.0:1777580312.840369:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.840371:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff0400, rc 0) 00000100:00100000:2.0:1777580312.840393:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283097:x1863919946662016:12345-192.168.202.9@tcp:101:rm.500 Request processed in 431us (6751us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.840399:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19508 00010000:00010000:0.0:1777580312.841047:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841060:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841070:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580312.841110:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ec:0x0]: returning size 0 00000004:00200000:0.0:1777580312.841113:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580312.841126:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841151:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841159:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841165:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841171:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841177:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.841180:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841186:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841196:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.841198:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.841202:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841209:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b0ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841237:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841243:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841250:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841255:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.841258:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841265:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841273:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02481358500) 00010000:00010000:0.0:1777580312.841275:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.841278:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841284:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b0f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841318:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b0e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5c6 expref: 365 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841332:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5c6 expref: 364 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.841350:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa024185aac00) 00010000:00010000:0.0:1777580312.841352:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.841355:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149600, rc 0) 00000100:00100000:0.0:1777580312.841395:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283081:x1863919946661376:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3805us (7873us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.841403:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19503 00000100:00100000:0.0:1777580312.841410:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788445030 time 7833788815300 state 0x2 ref 0 00010000:00010000:0.0:1777580312.850012:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850031:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850040:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850047:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.850053:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850062:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850084:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02427669600) 00010000:00010000:0.0:1777580312.850087:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.850093:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.850117:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4b0bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.855642:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.857333:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.860401:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.863966:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662144 00000100:00100000:0.0:1777580312.863988:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662144 00000100:00100000:0.0:1777580312.864092:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662272 00000100:00100000:0.0:1777580312.864096:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662272 00000100:00100000:0.0:1777580312.864131:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11932 00000100:00100000:0.0:1777580312.864158:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946662144:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.864185:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.864216:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5f0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.864255:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ae:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:0.0:1777580312.864293:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.864296:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.864307:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 22 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.864329:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 22 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.864345:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148600, rc 0) 00000100:00100000:0.0:1777580312.864431:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2362:x1863919946662144:12345-192.168.202.9@tcp:101:rm.500 Request processed in 275us (8803us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.864439:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11932 00000100:00100000:0.0:1777580312.864483:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11933 00000100:00100000:0.0:1777580312.864492:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2362:x1863919946662272:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580312.864500:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.864514:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5f7 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580312.864535:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d2:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:0.0:1777580312.864546:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.864548:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580312.864553:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 18 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.864564:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 18 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.864574:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149a00, rc 0) 00000100:00100000:0.0:1777580312.864593:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2362:x1863919946662272:12345-192.168.202.9@tcp:101:rm.500 Request processed in 103us (7272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580312.864599:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11933 00000100:00100000:2.0:1777580312.865179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.865201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.865219:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.865246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.865276:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662400 00000100:00100000:2.0:1777580312.865327:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662400 00000100:00100000:2.0:1777580312.865369:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662528 00000100:00100000:2.0:1777580312.865373:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662528 00000100:00100000:2.0:1777580312.865393:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662656 00000100:00100000:2.0:1777580312.865396:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662656 00000100:00100000:2.0:1777580312.865411:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946662784 00000100:00100000:2.0:1777580312.865414:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946662784 00000100:00100000:2.0:1777580312.865433:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11934 00000100:00100000:2.0:1777580312.865442:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946662400:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.865455:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.865486:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e5fe expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580312.865509:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d4:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:2.0:1777580312.865523:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.865524:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.865530:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.865545:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.865556:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1c00, rc 0) 00000100:00100000:2.0:1777580312.865593:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946662400:12345-192.168.202.9@tcp:101:rm.500 Request processed in 153us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.865600:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11934 00000100:00100000:2.0:1777580312.865618:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11935 00000100:00100000:2.0:1777580312.865624:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2361:x1863919946662528:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.865631:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.865643:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e605 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580312.865662:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b0:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:2.0:1777580312.865672:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.865673:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.865677:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 24 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.865702:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 24 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.865711:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff0200, rc 0) 00000100:00100000:2.0:1777580312.865731:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946662528:12345-192.168.202.9@tcp:101:rm.500 Request processed in 108us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.865738:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11935 00000100:00100000:2.0:1777580312.865751:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11936 00000100:00100000:2.0:1777580312.865758:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2364:x1863919946662656:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.865765:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.865776:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e60c expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580312.865789:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d3:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:2.0:1777580312.866486:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.866491:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.866500:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.866518:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.866530:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1e00, rc 0) 00000100:00100000:2.0:1777580312.866566:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2364:x1863919946662656:12345-192.168.202.9@tcp:101:rm.500 Request processed in 808us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.866583:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11936 00000100:00100000:2.0:1777580312.866608:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11937 00000100:00100000:2.0:1777580312.866616:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946662784:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580312.866628:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.866646:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e613 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580312.866664:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15af:0x0] initial LVB size: 0, mtime: 0x69f3b917, atime: 0x69f3b917, ctime: 0x69f3b917, blocks: 0x1 00010000:00010000:2.0:1777580312.866673:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.866674:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580312.866678:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 24 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.866688:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 24 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.866697:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff0e00, rc 0) 00000100:00100000:2.0:1777580312.866713:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946662784:12345-192.168.202.9@tcp:101:rm.500 Request processed in 100us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580312.866719:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11937 00000100:00100000:2.0:1777580312.866752:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946663040 00000100:00100000:2.0:1777580312.866758:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946663040 00000100:00100000:2.0:1777580312.866785:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833645343833 time 7833679333486 state 0x0 ref 1 00000100:00100000:2.0:1777580312.868618:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833679433486 time 7833679333486 state 0x1 ref 1 00000100:00100000:2.0:1777580312.868673:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833679433486 time 7833817535478 state 0x0 ref 1 00000100:00100000:2.0:1777580312.868696:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283075:x1863919946663040:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.868718:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.868742:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b1b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e61a expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869612:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869635:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869649:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869666:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869674:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.869680:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580312.871571:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d5:0x0], index 0: 0 00010000:00010000:2.0:1777580312.874098:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b1ce lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.874124:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.874159:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.874235:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881105:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881124:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881147:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.881154:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881166:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881191:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.881194:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.881201:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881209:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b1c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.881238:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000052bc1430 reply state 0000000021ff5b9c transno 8589950737 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.881262:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.881460:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b1b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e61a expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881479:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b1ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e61a expref: 365 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.881488:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:2.0:1777580312.881490:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.881493:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030200, rc 0) 00000100:00100000:2.0:1777580312.881592:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+366:283075:x1863919946663040:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12907us (16343us total) trans 8589950737 rc 0/0 00000100:00100000:2.0:1777580312.881603:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19509 00000100:00100000:2.0:1777580312.881612:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833679433486 time 7833817535478 state 0x2 ref 0 00010000:00010000:3.0:1777580312.890523:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890543:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890553:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890576:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.890582:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890591:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890614:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa0249f048b00) 00010000:00010000:3.0:1777580312.890618:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.890624:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.890630:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b1c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.893188:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580312.893773:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.895992:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946663296 00000100:00100000:0.0:1777580312.896012:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946663296 00000100:00100000:0.0:1777580312.896068:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833679433486 time 7833817535478 state 0x0 ref 1 00000100:00100000:0.0:1777580312.896085:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833817635478 time 7833817535478 state 0x1 ref 1 00000100:00100000:0.0:1777580312.896114:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946663552 00000100:00100000:0.0:1777580312.896119:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946663552 00000100:00100000:0.0:1777580312.896182:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833817635478 time 7833817535478 state 0x1 ref 2 00000100:00100000:0.0:1777580312.896203:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833845166080 time 7833845066080 state 0x1 ref 2 00000100:00100000:0.0:1777580312.896221:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+366:283075:x1863919946663296:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580312.896309:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.896344:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b1ce lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e61a expref: 366 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.896369:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:0.0:1777580312.896381:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.896486:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.896502:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.896514:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.896686:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007c84172c reply state 000000007b275257 transno 8589950738 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.896697:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.897196:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+367:283075:x1863919946663296:12345-192.168.202.9@tcp:36:touch.500 Request processed in 978us (4019us total) trans 8589950738 rc 0/0 00000100:00100000:0.0:1777580312.897208:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19510 00000100:00100000:0.0:1777580312.897254:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833845166080 time 7833846104867 state 0x0 ref 1 00000100:00100000:0.0:1777580312.897271:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+366:283076:x1863919946663552:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580312.897298:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580312.897314:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b1e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e621 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897575:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897590:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897600:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897617:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897623:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.897629:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580312.899117:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b1:0x0], index 1: 0 00010000:00010000:0.0:1777580312.900081:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b1f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.900103:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.900115:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.900996:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901004:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901011:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901017:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580312.901022:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901030:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901045:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580312.901048:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580312.901053:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.901058:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b1ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.901077:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000005aaf2cb reply state 000000005715a764 transno 8589950739 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.901087:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580312.902559:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b1e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e621 expref: 369 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.902611:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e621 expref: 368 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.902623:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa02481358500) 00010000:00010000:0.0:1777580312.902626:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580312.902629:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9800, rc 0) 00000100:00100000:0.0:1777580312.902976:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+369:283076:x1863919946663552:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5706us (9203us total) trans 8589950739 rc 0/0 00000100:00100000:0.0:1777580312.902988:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19511 00000100:00100000:0.0:1777580312.902999:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833845166080 time 7833846104867 state 0x2 ref 0 00000100:00100000:1.0:1777580312.932833:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580312.932914:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932930:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932938:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932944:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580312.932951:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932958:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932977:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa024814cad00) 00010000:00010000:1.0:1777580312.932981:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580312.932987:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580312.932992:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b1dc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580312.933251:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946663680 00000100:00100000:3.0:1777580312.933265:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946663680 00000100:00100000:3.0:1777580312.933315:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833845166080 time 7833846104867 state 0x0 ref 1 00000100:00100000:3.0:1777580312.933328:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833846204867 time 7833846104867 state 0x1 ref 1 00000100:00100000:3.0:1777580312.933355:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833846204867 time 7833882217072 state 0x0 ref 1 00000100:00100000:3.0:1777580312.933369:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283075:x1863919946663680:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580312.933411:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580312.933434:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b206 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e628 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.933506:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b206 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e628 expref: 369 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.933530:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b206 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e628 expref: 369 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.933547:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa024993df300) 00010000:00010000:3.0:1777580312.933550:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580312.933553:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8e00, rc 0) 00000100:00100000:3.0:1777580312.933622:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+369:283075:x1863919946663680:12345-192.168.202.9@tcp:101:touch.500 Request processed in 256us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580312.933631:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19512 00000100:00100000:3.0:1777580312.933637:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833846204867 time 7833882217072 state 0x2 ref 0 00010000:00010000:3.0:1777580312.936501:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936521:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936529:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936535:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580312.936540:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936549:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936570:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02427669600) 00010000:00010000:3.0:1777580312.936590:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580312.936597:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580312.936604:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b1f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.941971:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.943989:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946663936 00000100:00100000:0.0:1777580312.944007:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946663936 00000100:00100000:0.0:1777580312.944062:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833846204867 time 7833882217072 state 0x0 ref 1 00000100:00100000:0.0:1777580312.944078:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833882317072 time 7833882217072 state 0x1 ref 1 00000100:00100000:0.0:1777580312.944111:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833882317072 time 7833892973225 state 0x0 ref 1 00000100:00100000:0.0:1777580312.944128:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283076:x1863919946663936:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580312.944227:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580312.944261:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b1f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e621 expref: 368 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.944287:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa02481358500) 00010000:00010000:0.0:1777580312.944299:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580312.945131:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.945179:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580312.945193:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580312.945388:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003a90f31d reply state 000000007197e6bc transno 8589950740 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580312.945398:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580312.948213:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+369:283076:x1863919946663936:12345-192.168.202.9@tcp:36:touch.500 Request processed in 4075us (6240us total) trans 8589950740 rc 0/0 00000100:00100000:0.0:1777580312.948228:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19513 00000100:00100000:0.0:1777580312.948238:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833882317072 time 7833892973225 state 0x2 ref 0 00000100:00100000:3.0:1777580312.954818:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580312.954982:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580312.955691:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946664320 00000100:00100000:0.0:1777580312.955706:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946664320 00000100:00100000:0.0:1777580312.955786:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11938 00000100:00100000:0.0:1777580312.955806:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2361:x1863919946664320:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580312.956292:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2361:x1863919946664320:12345-192.168.202.9@tcp:2:touch.500 Request processed in 495us (1308us total) trans 8589939012 rc 0/0 00000100:00100000:0.0:1777580312.956302:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11938 00000100:00100000:2.0:1777580312.959894:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946664192 00000100:00100000:2.0:1777580312.959910:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946664192 00000100:00100000:2.0:1777580312.959959:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833882317072 time 7833892973225 state 0x0 ref 1 00000100:00100000:2.0:1777580312.959975:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833893073225 time 7833892973225 state 0x1 ref 1 00000100:00100000:2.0:1777580312.960001:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833893073225 time 7833908863558 state 0x0 ref 1 00000100:00100000:2.0:1777580312.960019:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+369:283078:x1863919946664192:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580312.960047:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580312.960074:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b214 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e62f expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960309:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960329:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960343:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960359:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960365:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.960371:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580312.963715:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d6:0x0], index 0: 0 00010000:00010000:2.0:1777580312.968218:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b229 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968249:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968264:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968318:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968345:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968353:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968359:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580312.968363:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968371:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968386:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580312.968389:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580312.968394:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968401:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b21b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580312.968422:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d9075ade reply state 00000000acbf202b transno 8589950741 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580312.968432:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580312.968480:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b214 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e62f expref: 372 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968498:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b229 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e62f expref: 371 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580312.968517:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa0249f048700) 00010000:00010000:2.0:1777580312.968519:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580312.968523:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:2.0:1777580312.968627:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283078:x1863919946664192:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8614us (13837us total) trans 8589950741 rc 0/0 00000100:00100000:2.0:1777580312.968638:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19514 00000100:00100000:2.0:1777580312.968647:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833893073225 time 7833908863558 state 0x2 ref 0 00000100:00100000:1.0:1777580313.014234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.014332:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.014354:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.014440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.014493:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014506:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014514:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014521:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.014526:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014534:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014554:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa02481358000) 00010000:00010000:1.0:1777580313.014558:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.014563:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014571:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b20d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014615:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014637:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014643:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014648:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.014651:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014657:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014665:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0249f048a00) 00010000:00010000:1.0:1777580313.014668:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.014671:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.014677:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b222 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.014717:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946664448 00000100:00100000:1.0:1777580313.014729:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946664448 00000100:00100000:1.0:1777580313.014775:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833893073225 time 7833908863558 state 0x0 ref 1 00000100:00100000:1.0:1777580313.014788:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833908963558 time 7833908863558 state 0x1 ref 1 00000100:00100000:1.0:1777580313.014807:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946664960 00000100:00100000:1.0:1777580313.014810:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946664960 00000100:00100000:1.0:1777580313.014821:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833908963558 time 7833908863558 state 0x1 ref 2 00000100:00100000:1.0:1777580313.014853:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946665216 00000100:00100000:1.0:1777580313.014856:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946665216 00000100:00100000:1.0:1777580313.014870:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833908963558 time 7833908863558 state 0x1 ref 3 00000100:00100000:1.0:1777580313.014892:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833963855009 time 7833963755009 state 0x1 ref 3 00000100:00100000:1.0:1777580313.014904:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283076:x1863919946664448:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.014936:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.014959:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b237 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e636 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015031:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e636 expref: 373 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015045:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b237 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e636 expref: 373 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015066:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa024185aa100) 00010000:00010000:1.0:1777580313.015069:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.015071:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838600, rc 0) 00000100:00100000:1.0:1777580313.015172:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283076:x1863919946664448:12345-192.168.202.9@tcp:101:touch.500 Request processed in 269us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.015181:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19515 00000100:00100000:1.0:1777580313.015208:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964171224 time 7833964071224 state 0x1 ref 2 00000100:00100000:1.0:1777580313.015218:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283078:x1863919946664960:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.015277:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.015294:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b229 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e62f expref: 372 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015309:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa0249f048700) 00010000:00010000:1.0:1777580313.015317:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.015385:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015394:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015403:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.015565:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000912dede4 reply state 00000000a542c556 transno 8589950742 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.015575:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.015633:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283078:x1863919946664960:12345-192.168.202.9@tcp:36:touch.500 Request processed in 415us (1277us total) trans 8589950742 rc 0/0 00000100:00100000:1.0:1777580313.015639:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19516 00000100:00100000:1.0:1777580313.015656:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964171224 time 7833964519124 state 0x0 ref 1 00000100:00100000:1.0:1777580313.015666:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283083:x1863919946665216:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.015674:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.015684:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b245 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e63d expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015801:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015812:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015820:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015846:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015853:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.015860:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.016423:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b2:0x0], index 1: 0 00010000:00010000:1.0:1777580313.016594:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b25a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016605:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b25a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016614:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b25a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016653:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016670:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016676:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016683:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.016687:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016694:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016705:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.016708:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.016712:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016718:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b24c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.016731:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dc516f36 reply state 000000005625fea6 transno 8589950743 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.016739:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.016771:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b245 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e63d expref: 375 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016786:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b25a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e63d expref: 374 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.016803:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa024814cad00) 00010000:00010000:1.0:1777580313.016806:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.016809:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838800, rc 0) 00000100:00100000:1.0:1777580313.016880:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+375:283083:x1863919946665216:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1214us (2438us total) trans 8589950743 rc 0/0 00000100:00100000:1.0:1777580313.016887:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19517 00000100:00100000:1.0:1777580313.016894:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964171224 time 7833964519124 state 0x2 ref 0 00000100:00100000:1.0:1777580313.017002:0:187655:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:187655:1863919917477760:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777580313.017071:0:187655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580313.017119:0:187655:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508180 going to sleep for 11 seconds 00000100:00100000:1.0:1777580313.017169:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917477760 00000100:00100000:1.0:1777580313.017176:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917477760 00000100:00100000:1.0:1777580313.017229:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11939 00000100:00100000:1.0:1777580313.017237:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+38:187655:x1863919917477760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1777580313.017286:0:207637:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 5570 00000100:00080000:2.0:1777580313.018233:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777580313.039452:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946664704 00000100:00100000:0.0:1777580313.039469:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946664704 00000100:00100000:0.0:1777580313.039552:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4181 00000100:00100000:0.0:1777580313.039564:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+375:283075:x1863919946664704:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580313.040127:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+376:283075:x1863919946664704:12345-192.168.202.9@tcp:35:touch.500 Request processed in 562us (25790us total) trans 8589950744 rc 0/0 00000100:00100000:0.0:1777580313.040176:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4181 00000100:00100000:1.0:1777580313.044884:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+39:187655:x1863919917477760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27639us (27804us total) trans 8589938610 rc 0/0 00000100:00100000:1.0:1777580313.044901:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11939 00000100:00100000:2.0:1777580313.049305:0:187655:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:187655:1863919917477760:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777580313.049333:0:187655:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x15b2:0x0]-[0x280000400:0x15e1:0x0] 00000004:00080000:2.0:1777580313.049447:0:187655:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7833998311513ns, next at 7834998308635ns, rc = 0 00000100:00100000:0.0:1777580313.051962:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917477888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777580313.052064:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580313.052184:0:192556:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917477888 00000100:00100000:0.0:1777580313.052193:0:192556:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917477888 00000100:00100000:0.0:1777580313.052261:0:192556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1777580313.052272:0:192556:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917477888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777580313.052303:0:192556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 3819962368 avail 3817865216 00000100:00100000:0.0:1777580313.052358:0:192556:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917477888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.052366:0:192556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1777580313.052460:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917477888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777580313.056468:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.064296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.064338:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.064419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.064480:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064510:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064519:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064526:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.064533:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064540:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064561:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa024185aa600) 00010000:00010000:1.0:1777580313.064564:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.064569:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064575:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b23e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064621:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064628:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064634:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064639:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.064649:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064654:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064662:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa024185aaf00) 00010000:00010000:1.0:1777580313.064665:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.064667:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.064673:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b253 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.064705:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946665472 00000100:00100000:1.0:1777580313.064717:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946665472 00000100:00100000:1.0:1777580313.064762:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964171224 time 7833964519124 state 0x0 ref 1 00000100:00100000:1.0:1777580313.064777:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964619124 time 7833964519124 state 0x1 ref 1 00000100:00100000:1.0:1777580313.064797:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946665728 00000100:00100000:1.0:1777580313.064800:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946665728 00000100:00100000:1.0:1777580313.064814:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964619124 time 7833964519124 state 0x1 ref 2 00000100:00100000:1.0:1777580313.064839:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946665984 00000100:00100000:1.0:1777580313.064843:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946665984 00000100:00100000:1.0:1777580313.064854:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833964619124 time 7833964519124 state 0x1 ref 3 00000100:00100000:1.0:1777580313.064873:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834013835810 time 7834013735810 state 0x1 ref 3 00000100:00100000:1.0:1777580313.064886:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+376:283078:x1863919946665472:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.064923:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.064947:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b268 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e644 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065017:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b268 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e644 expref: 377 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065031:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b268 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e644 expref: 377 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065050:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa02484c59800) 00010000:00010000:1.0:1777580313.065052:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.065055:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839e00, rc 0) 00000100:00100000:1.0:1777580313.065122:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+377:283078:x1863919946665472:12345-192.168.202.9@tcp:101:touch.500 Request processed in 238us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.065130:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19518 00000100:00100000:1.0:1777580313.065220:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014182607 time 7834014082607 state 0x1 ref 2 00000100:00100000:1.0:1777580313.065231:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+376:283083:x1863919946665728:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.065277:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.065295:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b25a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e63d expref: 376 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065306:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa024814cad00) 00010000:00010000:1.0:1777580313.065314:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.065387:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065403:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065412:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.065591:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000093f02dff reply state 00000000bc590e3c transno 8589950745 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.065602:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.065670:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+377:283083:x1863919946665728:12345-192.168.202.9@tcp:36:touch.500 Request processed in 440us (1331us total) trans 8589950745 rc 0/0 00000100:00100000:1.0:1777580313.065677:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19519 00000100:00100000:1.0:1777580313.065697:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014182607 time 7834014559802 state 0x0 ref 1 00000100:00100000:1.0:1777580313.065707:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+376:283087:x1863919946665984:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.065716:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.065727:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b276 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e64b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065855:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065866:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065874:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065900:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065908:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.065914:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.066465:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d7:0x0], index 0: 0 00010000:00010000:1.0:1777580313.066630:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b28b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066642:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066652:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b28b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066689:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066696:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066703:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066709:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.066714:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066732:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066744:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.066747:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.066751:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066758:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b27d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.066773:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cadb2c2c reply state 00000000ca4ca4c5 transno 8589950746 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.066782:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.066815:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b276 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e64b expref: 379 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066845:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b28b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e64b expref: 378 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.066852:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481646a00) 00010000:00010000:1.0:1777580313.066855:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.066857:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:1.0:1777580313.066918:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+379:283087:x1863919946665984:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1211us (2498us total) trans 8589950746 rc 0/0 00000100:00100000:1.0:1777580313.066926:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19520 00000100:00100000:1.0:1777580313.066933:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014182607 time 7834014559802 state 0x2 ref 0 00000100:00100000:3.0:1777580313.067942:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946665344 00000100:00100000:3.0:1777580313.067956:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946665344 00000100:00100000:3.0:1777580313.068040:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11940 00000100:00100000:3.0:1777580313.068051:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946665344:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580313.068450:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946665344:12345-192.168.202.9@tcp:2:touch.500 Request processed in 401us (11995us total) trans 8589938611 rc 0/0 00000100:00100000:3.0:1777580313.068458:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11940 00000100:00100000:0.0:1777580313.077025:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.077076:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.077193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.077233:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946666240 00000100:00100000:0.0:1777580313.077246:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946666240 00000100:00100000:0.0:1777580313.077303:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014182607 time 7834014559802 state 0x0 ref 1 00000100:00100000:0.0:1777580313.077320:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014659802 time 7834014559802 state 0x1 ref 1 00000100:00100000:0.0:1777580313.077342:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946666496 00000100:00100000:0.0:1777580313.077345:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946666496 00000100:00100000:0.0:1777580313.077357:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834014659802 time 7834014559802 state 0x1 ref 2 00000100:00100000:0.0:1777580313.077396:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026358980 time 7834026258980 state 0x1 ref 2 00000100:00100000:0.0:1777580313.077410:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+380:283087:x1863919946666240:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580313.077484:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580313.077519:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b28b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e64b expref: 380 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.077544:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481646a00) 00010000:00010000:0.0:1777580313.077557:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.077654:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.077670:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.077681:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.077878:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000731a6325 reply state 00000000ad24009a transno 8589950747 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.077889:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.078000:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:283087:x1863919946666240:12345-192.168.202.9@tcp:36:touch.500 Request processed in 591us (987us total) trans 8589950747 rc 0/0 00000100:00100000:0.0:1777580313.078010:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19521 00000100:00100000:0.0:1777580313.078036:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026358980 time 7834026899092 state 0x0 ref 1 00000100:00100000:0.0:1777580313.078049:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+380:283090:x1863919946666496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.078071:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.078085:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b2a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e652 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078236:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078249:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078258:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078273:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078280:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.078287:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580313.078798:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b3:0x0], index 1: 0 00010000:00010000:0.0:1777580313.078999:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b2b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079011:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079020:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079068:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079075:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079083:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079089:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.079093:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079101:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079114:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.079117:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.079121:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079128:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b2a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.079167:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007cc9524 reply state 00000000c05e0525 transno 8589950748 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.079176:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580313.079209:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b2a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e652 expref: 383 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079234:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e652 expref: 382 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.079242:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02498977100) 00010000:00010000:0.0:1777580313.079245:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580313.079247:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9800, rc 0) 00000100:00100000:0.0:1777580313.079307:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:283090:x1863919946666496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1261us (2230us total) trans 8589950748 rc 0/0 00000100:00100000:0.0:1777580313.079315:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19522 00000100:00100000:0.0:1777580313.079321:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026358980 time 7834026899092 state 0x2 ref 0 00000100:00100000:0.0:1777580313.079375:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946666624 00000100:00100000:0.0:1777580313.079384:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946666624 00000100:00100000:0.0:1777580313.079461:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11941 00000100:00100000:0.0:1777580313.079470:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946666624:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580313.079717:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2362:x1863919946666624:12345-192.168.202.9@tcp:2:touch.500 Request processed in 248us (2523us total) trans 8589939013 rc 0/0 00000100:00100000:0.0:1777580313.079725:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11941 00010000:00010000:1.0:1777580313.082160:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082182:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082190:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082197:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.082203:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082211:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082231:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:1.0:1777580313.082234:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.082240:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082260:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b26f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082309:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082317:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082323:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082352:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.082355:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082361:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082369:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02484c59100) 00010000:00010000:1.0:1777580313.082372:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.082374:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.082379:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b284 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777580313.083106:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580313.085797:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.085881:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946666752 00000100:00100000:1.0:1777580313.085894:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946666752 00000100:00100000:1.0:1777580313.085942:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026358980 time 7834026899092 state 0x0 ref 1 00000100:00100000:1.0:1777580313.085957:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026999092 time 7834026899092 state 0x1 ref 1 00000100:00100000:1.0:1777580313.085991:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026999092 time 7834034853045 state 0x0 ref 1 00000100:00100000:1.0:1777580313.086004:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:283083:x1863919946666752:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.086034:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.086063:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b2c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e659 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.086188:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e659 expref: 382 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.086221:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e659 expref: 382 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.086243:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02481646b00) 00010000:00010000:1.0:1777580313.086247:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.086251:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fe00, rc 0) 00000100:00100000:1.0:1777580313.086320:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+382:283083:x1863919946666752:12345-192.168.202.9@tcp:101:touch.500 Request processed in 318us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.086329:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19523 00000100:00100000:1.0:1777580313.086335:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026999092 time 7834034853045 state 0x2 ref 0 00000100:00100000:0.0:1777580313.093728:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.093771:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946667008 00000100:00100000:0.0:1777580313.093783:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946667008 00000100:00100000:0.0:1777580313.093850:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4182 00000100:00100000:0.0:1777580313.093862:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+382:283076:x1863919946667008:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580313.094315:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:283076:x1863919946667008:12345-192.168.202.9@tcp:35:touch.500 Request processed in 453us (597us total) trans 8589950749 rc 0/0 00000100:00100000:0.0:1777580313.094338:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4182 00000100:00100000:1.0:1777580313.114633:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.114731:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.114763:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114777:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114785:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114792:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.114797:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114806:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114849:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02481358000) 00010000:00010000:1.0:1777580313.114852:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.114857:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.114863:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b2ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.114914:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946667392 00000100:00100000:1.0:1777580313.114925:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946667392 00000100:00100000:1.0:1777580313.114967:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834026999092 time 7834034853045 state 0x0 ref 1 00000100:00100000:1.0:1777580313.114981:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834034953045 time 7834034853045 state 0x1 ref 1 00000100:00100000:1.0:1777580313.115001:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946667648 00000100:00100000:1.0:1777580313.115004:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946667648 00000100:00100000:1.0:1777580313.115014:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834034953045 time 7834034853045 state 0x1 ref 2 00000100:00100000:1.0:1777580313.115033:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834063995685 time 7834063895685 state 0x1 ref 2 00000100:00100000:1.0:1777580313.115045:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:283091:x1863919946667392:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.115072:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.115091:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b2ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e660 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115302:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115318:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115335:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115352:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115358:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.115364:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.115975:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d8:0x0], index 0: 0 00010000:00010000:1.0:1777580313.116223:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b2df lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116236:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b2df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116246:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b2df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116283:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116291:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116299:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116304:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.116316:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116323:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116337:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.116340:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.116344:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116350:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b2d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.116364:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000635b0289 reply state 000000002e211d03 transno 8589950750 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.116374:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.116412:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b2ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e660 expref: 386 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116428:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b2df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e660 expref: 385 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116435:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580313.116437:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.116440:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00000100:00100000:1.0:1777580313.116540:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283091:x1863919946667392:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1496us (1921us total) trans 8589950750 rc 0/0 00000100:00100000:1.0:1777580313.116551:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19524 00000100:00100000:1.0:1777580313.116596:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834063995685 time 7834065457441 state 0x0 ref 1 00000100:00100000:1.0:1777580313.116613:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+385:283090:x1863919946667648:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.116657:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.116671:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b2b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e652 expref: 385 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116685:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02498977100) 00010000:00010000:1.0:1777580313.116694:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.116761:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116769:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.116776:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.116779:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:1.0:1777580313.116885:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007b66d851 reply state 000000004a9709b9 transno 8589950751 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.116893:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580313.116912:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.116933:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283090:x1863919946667648:12345-192.168.202.9@tcp:36:touch.500 Request processed in 327us (2202us total) trans 8589950751 rc 0/0 00000100:00100000:3.0:1777580313.116941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.116941:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19525 00000100:00100000:1.0:1777580313.116946:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834063995685 time 7834065457441 state 0x2 ref 0 00000100:00100000:1.0:1777580313.116961:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668032 00000100:00100000:1.0:1777580313.116969:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668032 00000100:00100000:1.0:1777580313.116990:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834063995685 time 7834065457441 state 0x0 ref 1 00000100:00100000:1.0:1777580313.117006:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065557441 time 7834065457441 state 0x1 ref 1 00000100:00100000:1.0:1777580313.117025:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065557441 time 7834065889071 state 0x0 ref 1 00000100:00100000:1.0:1777580313.117034:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283087:x1863919946668032:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.117046:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.117057:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b2f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e667 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.117088:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e667 expref: 387 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.117099:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e667 expref: 387 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.117115:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481358500) 00010000:00010000:1.0:1777580313.117117:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.117119:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838e00, rc 0) 00000100:00100000:1.0:1777580313.117168:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283087:x1863919946668032:12345-192.168.202.9@tcp:101:touch.500 Request processed in 134us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.117174:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19526 00000100:00100000:1.0:1777580313.117178:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065557441 time 7834065889071 state 0x2 ref 0 00010000:00010000:2.0:1777580313.117462:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117472:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117479:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117485:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.117490:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117497:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117517:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481358500) 00010000:00010000:2.0:1777580313.117519:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.117522:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.117528:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b299 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.117971:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946667136 00000100:00100000:0.0:1777580313.117980:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946667136 00000100:00100000:0.0:1777580313.118028:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11942 00000100:00100000:0.0:1777580313.118038:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2361:x1863919946667136:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580313.118426:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2361:x1863919946667136:12345-192.168.202.9@tcp:2:touch.500 Request processed in 388us (1645us total) trans 8589938612 rc 0/0 00000100:00100000:0.0:1777580313.118435:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11942 00000100:00100000:0.0:1777580313.118467:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946667904 00000100:00100000:0.0:1777580313.118472:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946667904 00000100:00100000:0.0:1777580313.118501:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4183 00000100:00100000:0.0:1777580313.118508:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283078:x1863919946667904:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580313.118756:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283078:x1863919946667904:12345-192.168.202.9@tcp:35:touch.500 Request processed in 247us (1842us total) trans 8589950752 rc 0/0 00000100:00100000:0.0:1777580313.118764:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4183 00010000:00010000:2.0:1777580313.130332:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580313.130947:0:187653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7834079810839ns, next at 7835079807494ns, rc = 0 00000100:00100000:1.0:1777580313.132644:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917478016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777580313.132739:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580313.133743:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.133784:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.133810:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.133851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.133880:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133893:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133901:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133907:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.133912:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133921:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133940:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:1.0:1777580313.133943:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.133947:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.133954:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b2ed lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.133990:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668160 00000100:00100000:1.0:1777580313.133999:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668160 00000100:00100000:1.0:1777580313.134038:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065557441 time 7834065889071 state 0x0 ref 1 00000100:00100000:1.0:1777580313.134050:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065989071 time 7834065889071 state 0x1 ref 1 00000100:00100000:1.0:1777580313.134075:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668416 00000100:00100000:1.0:1777580313.134078:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668416 00000100:00100000:1.0:1777580313.134088:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834065989071 time 7834065889071 state 0x1 ref 2 00000100:00100000:1.0:1777580313.134098:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668672 00000100:00100000:1.0:1777580313.134100:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668672 00000100:00100000:1.0:1777580313.134108:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788445030 time 7833788815300 state 0x0 ref 1 00000100:00100000:1.0:1777580313.134114:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788915300 time 7833788815300 state 0x1 ref 1 00000100:00100000:1.0:1777580313.134131:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788915300 time 7834082992728 state 0x0 ref 1 00000100:00100000:1.0:1777580313.134167:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283071:x1863919946668672:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.134194:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.134212:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b2fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e675 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.136492:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085442991 time 7834085342991 state 0x1 ref 2 00000100:00100000:0.0:1777580313.136539:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283090:x1863919946668160:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.136566:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.136598:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b302 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e66e expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.136681:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b302 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e66e expref: 390 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.136722:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b302 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e66e expref: 390 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.136745:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02498977c00) 00010000:00010000:0.0:1777580313.136749:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580313.136752:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000100:00100000:0.0:1777580313.136859:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283090:x1863919946668160:12345-192.168.202.9@tcp:101:touch.500 Request processed in 344us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.136868:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19527 00000100:00100000:0.0:1777580313.136905:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085442991 time 7834085767727 state 0x0 ref 1 00000100:00100000:0.0:1777580313.136916:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283091:x1863919946668416:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580313.136966:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580313.136987:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b2df lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e660 expref: 389 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.137003:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580313.137011:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.137079:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.137088:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.137096:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137527:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137540:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137548:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.137558:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917478016 00010000:00010000:1.0:1777580313.137564:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.137569:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917478016 00010000:00010000:1.0:1777580313.137571:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137586:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.137648:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1777580313.137656:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917478016:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1777580313.137659:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137666:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137673:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1777580313.137675:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 3845128192 avail 3843031040 00010000:00010000:1.0:1777580313.137679:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.137684:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137691:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137701:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.137703:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.137707:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137713:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b310 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137723:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137728:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137740:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137745:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1cc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.137747:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137753:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.137755:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917478016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (5016us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580313.137761:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024814cad00) 00000100:00100000:3.0:1777580313.137762:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:1.0:1777580313.137764:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.137766:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137771:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b317 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137806:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b2fb lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e675 expref: 388 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137817:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.137819:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.137832:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4b2fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e675 expref: 388 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.137841:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839800, rc 0) 00000100:00100000:1.0:1777580313.137876:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283071:x1863919946668672:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3712us (4065us total) trans 0 rc 301/301 00000100:00100000:1.0:1777580313.137893:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19529 00000100:00100000:1.0:1777580313.137899:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788915300 time 7834082992728 state 0x2 ref 0 00000100:00100000:1.0:1777580313.137985:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917478016:0@lo:13:osp-pre-0-0.0 00000004:00010000:0.0:1777580313.138459:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fabe030e reply state 000000000f0e7377 transno 8589950753 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.138472:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580313.138479:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138487:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138493:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138498:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.138501:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138507:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138518:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02481646400) 00010000:00010000:3.0:1777580313.138520:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.138523:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.138528:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4b2d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.138557:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283091:x1863919946668416:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1641us (4770us total) trans 8589950753 rc 0/0 00000100:00100000:0.0:1777580313.138566:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19528 00000100:00100000:0.0:1777580313.138571:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085442991 time 7834085767727 state 0x2 ref 0 00000100:00100000:0.0:1777580313.138605:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668544 00000100:00100000:0.0:1777580313.138611:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668544 00000100:00100000:0.0:1777580313.138656:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11943 00000100:00100000:0.0:1777580313.138664:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2363:x1863919946668544:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580313.138964:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946668544:12345-192.168.202.9@tcp:2:touch.500 Request processed in 301us (5112us total) trans 8589939014 rc 0/0 00000100:00100000:0.0:1777580313.138972:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11943 00000100:00080000:2.0:1777580313.142599:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777580313.149221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580313.154319:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154340:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154349:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154364:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.154370:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154378:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154399:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa02498977900) 00010000:00010000:3.0:1777580313.154401:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777580313.154403:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946668928 00010000:00010000:3.0:1777580313.154407:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.154413:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b309 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.154415:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946668928 00000100:00100000:1.0:1777580313.154478:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4184 00000100:00100000:1.0:1777580313.154489:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283083:x1863919946668928:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580313.154961:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283083:x1863919946668928:12345-192.168.202.9@tcp:35:touch.500 Request processed in 472us (5749us total) trans 8589950754 rc 0/0 00000100:00100000:1.0:1777580313.154970:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4184 00000100:00100000:1.0:1777580313.169460:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.169519:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.169544:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.169607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.169642:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946669568 00000100:00100000:1.0:1777580313.169655:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946669568 00000100:00100000:1.0:1777580313.169705:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7833788915300 time 7834082992728 state 0x0 ref 1 00000100:00100000:1.0:1777580313.169721:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834083092728 time 7834082992728 state 0x1 ref 1 00000100:00100000:1.0:1777580313.169743:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946669696 00000100:00100000:1.0:1777580313.169746:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946669696 00000100:00100000:1.0:1777580313.169758:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085442991 time 7834085767727 state 0x0 ref 1 00000100:00100000:1.0:1777580313.169765:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085867727 time 7834085767727 state 0x1 ref 1 00000100:00100000:1.0:1777580313.169799:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834083092728 time 7834118661438 state 0x0 ref 1 00000100:00100000:1.0:1777580313.169813:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283081:x1863919946669568:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580313.169893:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580313.169930:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b188 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5c6 expref: 388 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.169961:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4aec5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e579 expref: 387 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.169974:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa024185aac00) 00010000:00010000:1.0:1777580313.169988:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.170019:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170036:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170047:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170063:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170070:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170077:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170306:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170315:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170323:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580313.170898:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1873, 64 off128064 00010000:00010000:1.0:1777580313.170976:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170987:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.170997:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171005:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171012:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171020:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171038:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580313.171061:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171080:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171086:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171093:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.171097:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171105:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171115:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa02481358000) 00010000:00010000:1.0:1777580313.171118:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580313.171122:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171129:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d200/0xcb2b2f2f7e4b32c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171178:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171184:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171189:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171195:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1c200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.171203:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171209:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171216:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.171219:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.171222:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171228:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1c200/0xcb2b2f2f7e4b31e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.171239:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003a258a6c reply state 000000001f82c381 transno 8589950755 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.171250:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.171362:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283081:x1863919946669568:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1547us (1811us total) trans 8589950755 rc 0/0 00000100:00100000:1.0:1777580313.171371:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19530 00000100:00100000:1.0:1777580313.171379:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834083092728 time 7834118661438 state 0x2 ref 0 00000100:00100000:1.0:1777580313.171418:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085867727 time 7834120280978 state 0x0 ref 1 00000100:00100000:1.0:1777580313.171432:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283091:x1863919946669696:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.171451:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.171467:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b33a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e67c expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171527:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b33a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e67c expref: 388 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171539:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b33a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e67c expref: 388 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.171557:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580313.171560:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.171563:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1cc00, rc 0) 00000100:00100000:1.0:1777580313.171586:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283091:x1863919946669696:12345-192.168.202.9@tcp:101:touch.500 Request processed in 159us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.171593:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19531 00000100:00100000:1.0:1777580313.171597:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085867727 time 7834120280978 state 0x2 ref 0 00000100:00100000:2.0:1777580313.172951:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946669184 00000100:00100000:2.0:1777580313.172966:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946669184 00000100:00100000:2.0:1777580313.173033:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4185 00000100:00100000:2.0:1777580313.173043:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283087:x1863919946669184:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580313.173465:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283087:x1863919946669184:12345-192.168.202.9@tcp:35:touch.500 Request processed in 422us (4018us total) trans 8589950756 rc 0/0 00000100:00100000:2.0:1777580313.173473:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4185 00000100:00100000:2.0:1777580313.173505:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946669312 00000100:00100000:2.0:1777580313.173509:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946669312 00000100:00100000:2.0:1777580313.173538:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11944 00000100:00100000:2.0:1777580313.173544:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946669312:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580313.173777:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946669312:12345-192.168.202.9@tcp:2:touch.500 Request processed in 233us (4258us total) trans 8589938613 rc 0/0 00000100:00100000:2.0:1777580313.173784:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11944 00010000:00010000:2.0:1777580313.173806:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580313.173815:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.175413:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1da00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580313.175419:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.175430:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.175452:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ec:0x0].0x0 (ffffa02481358000) 00010000:00010000:2.0:1777580313.175456:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580313.175462:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.175468:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1da00/0xcb2b2f2f7e4b333 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.175499:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580313.175502:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580313.175504:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580313.185559:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185580:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185588:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185595:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.185600:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185625:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185647:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024814cad00) 00010000:00010000:2.0:1777580313.185650:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.185655:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.185660:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1d600/0xcb2b2f2f7e4b325 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.195641:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.195763:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.196079:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946670080 00000100:00100000:3.0:1777580313.196091:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946670080 00000100:00100000:3.0:1777580313.196150:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834083092728 time 7834118661438 state 0x0 ref 1 00000100:00100000:3.0:1777580313.196167:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834118761438 time 7834118661438 state 0x1 ref 1 00000100:00100000:3.0:1777580313.196205:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834118761438 time 7834145067261 state 0x0 ref 1 00000100:00100000:3.0:1777580313.196218:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283086:x1863919946670080:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580313.196296:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580313.196329:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4b111 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5cd expref: 388 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196349:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4af2e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e587 expref: 387 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196370:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993df500) 00010000:00010000:3.0:1777580313.196381:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.196408:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196424:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196435:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196450:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196456:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196462:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196620:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196630:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.196637:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580313.197266:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1869, 64 off127808 00000100:00100000:0.0:1777580313.197309:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946669824 00000100:00100000:0.0:1777580313.197316:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946669824 00010000:00010000:3.0:1777580313.197341:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197357:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.197364:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11945 00010000:00010000:3.0:1777580313.197366:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.197373:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2364:x1863919946669824:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:3.0:1777580313.197374:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197381:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197388:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197405:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580313.197427:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197433:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197439:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197445:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.197450:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197457:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197477:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580313.197481:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580313.197484:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197490:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b34f lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197509:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197515:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197520:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197524:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.197526:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197531:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197538:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580313.197541:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.197543:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.197548:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b341 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.197569:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000903f50a2 reply state 00000000a974647f transno 8589950757 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.197577:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.198693:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946669824:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1313us (2922us total) trans 8589939015 rc 0/0 00000100:00100000:0.0:1777580313.198705:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11945 00000100:00100000:3.0:1777580313.200623:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283086:x1863919946670080:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4393us (4980us total) trans 8589950757 rc 0/0 00000100:00100000:3.0:1777580313.200639:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19532 00000100:00100000:3.0:1777580313.200649:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834118761438 time 7834145067261 state 0x2 ref 0 00010000:00010000:3.0:1777580313.200702:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580313.200712:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.200722:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580313.200727:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.200738:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.200757:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ed:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580313.200761:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580313.200765:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.200771:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b356 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.201756:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.201760:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.201769:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580313.204444:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.204916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580313.204951:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.204965:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.204974:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.204981:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.204987:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.204995:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.205014:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024993df900) 00010000:00010000:3.0:1777580313.205018:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.205022:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.205030:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b348 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.207163:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946670336 00000100:00100000:2.0:1777580313.207183:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946670336 00000100:00100000:2.0:1777580313.207265:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946670592 00000100:00100000:2.0:1777580313.207269:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946670592 00000100:00100000:2.0:1777580313.207294:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4186 00000100:00100000:2.0:1777580313.207305:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283090:x1863919946670336:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580313.207777:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283090:x1863919946670336:12345-192.168.202.9@tcp:35:touch.500 Request processed in 472us (3343us total) trans 8589950758 rc 0/0 00000100:00100000:2.0:1777580313.207786:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4186 00000100:00100000:2.0:1777580313.207815:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4187 00000100:00100000:2.0:1777580313.207834:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283091:x1863919946670592:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580313.207976:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283091:x1863919946670592:12345-192.168.202.9@tcp:35:touch.500 Request processed in 155us (3061us total) trans 8589950759 rc 0/0 00000100:00100000:2.0:1777580313.207983:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4187 00000100:00100000:0.0:1777580313.222280:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.222535:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946670848 00000100:00100000:3.0:1777580313.222549:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946670848 00000100:00100000:3.0:1777580313.222602:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834118761438 time 7834145067261 state 0x0 ref 1 00000100:00100000:3.0:1777580313.222618:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834145167261 time 7834145067261 state 0x1 ref 1 00000100:00100000:3.0:1777580313.222668:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834145167261 time 7834171530242 state 0x0 ref 1 00000100:00100000:3.0:1777580313.222687:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283095:x1863919946670848:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580313.222764:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580313.222807:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b12d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5d4 expref: 389 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222842:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b031 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b1 expref: 388 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222855:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580313.222868:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.222898:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222914:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222925:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222942:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222950:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.222956:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223116:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223124:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223149:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580313.223718:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1874, 64 off128128 00010000:00010000:3.0:1777580313.223788:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223801:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223812:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223832:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223840:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223847:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223875:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580313.223900:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223916:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223923:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223930:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.223935:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223943:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223954:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580313.223957:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580313.223961:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223968:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b36b lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223989:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.223995:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.224000:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.224006:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.224016:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.224023:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.224030:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580313.224032:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.224035:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.224040:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b35d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.224049:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000081c7f243 reply state 00000000430c2ed7 transno 8589950760 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.224059:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580313.224181:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283095:x1863919946670848:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1499us (1912us total) trans 8589950760 rc 0/0 00010000:00010000:0.0:1777580313.224183:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777580313.224191:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19533 00010000:00010000:0.0:1777580313.224191:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.224197:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc157f320) 00000100:00100000:3.0:1777580313.224199:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834145167261 time 7834171530242 state 0x2 ref 0 00010000:00010000:0.0:1777580313.224200:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.224207:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.224215:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f0:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:0.0:1777580313.224217:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.224220:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.224225:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b372 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.224240:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.224242:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.224243:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580313.235655:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235686:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235696:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235703:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.235709:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235719:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235739:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024993df900) 00010000:00010000:2.0:1777580313.235742:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.235747:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.235754:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b364 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.246863:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.248453:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946671104 00000100:00100000:1.0:1777580313.248472:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946671104 00000100:00100000:1.0:1777580313.248528:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834145167261 time 7834171530242 state 0x0 ref 1 00000100:00100000:1.0:1777580313.248544:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834171630242 time 7834171530242 state 0x1 ref 1 00000100:00100000:1.0:1777580313.248581:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834171630242 time 7834197443368 state 0x0 ref 1 00000100:00100000:1.0:1777580313.248599:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283097:x1863919946671104:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580313.248702:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580313.248739:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b181 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e9 expref: 388 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.248780:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4b000 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5aa expref: 387 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.248791:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa0248e788d00) 00010000:00010000:1.0:1777580313.248807:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.251319:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251352:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251369:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251390:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251398:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251405:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251577:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251586:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.251594:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580313.252239:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1870, 64 off127872 00010000:00010000:1.0:1777580313.252318:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252330:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252339:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252348:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252354:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252360:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252389:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580313.252418:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252424:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252430:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252436:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.252441:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252455:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252468:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa024185aa600) 00010000:00010000:1.0:1777580313.252472:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580313.252477:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252483:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b387 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252503:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252509:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252515:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252521:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.252523:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252529:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252535:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.252538:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.252541:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.252555:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b379 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.252565:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b6f9b0a6 reply state 00000000a7983fee transno 8589950761 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.252574:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.252697:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283097:x1863919946671104:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4099us (5841us total) trans 8589950761 rc 0/0 00000100:00100000:1.0:1777580313.252709:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19534 00000100:00100000:1.0:1777580313.252719:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834171630242 time 7834197443368 state 0x2 ref 0 00010000:00010000:3.0:1777580313.256065:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580313.256082:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.256095:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580313.256100:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.256167:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.256189:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ef:0x0].0x0 (ffffa024185aa600) 00010000:00010000:3.0:1777580313.256192:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580313.256197:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.256203:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b38e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.256233:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.256235:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.256237:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580313.282013:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580313.282215:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282229:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282238:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282269:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.282276:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282284:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282305:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024185aac00) 00010000:00010000:0.0:1777580313.282309:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.282314:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.282322:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b380 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.282457:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946671360 00000100:00100000:1.0:1777580313.282469:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946671360 00000100:00100000:1.0:1777580313.282511:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834171630242 time 7834197443368 state 0x0 ref 1 00000100:00100000:1.0:1777580313.282525:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834197543368 time 7834197443368 state 0x1 ref 1 00000100:00100000:1.0:1777580313.282589:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834197543368 time 7834231451161 state 0x0 ref 1 00000100:00100000:1.0:1777580313.282604:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283096:x1863919946671360:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580313.282679:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580313.282701:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b149 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5db expref: 387 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282718:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b077 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5b8 expref: 386 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282742:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa500) 00010000:00010000:1.0:1777580313.282751:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.282779:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282794:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282804:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282831:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282839:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282844:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.282998:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.283006:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.283012:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580313.285949:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1871, 64 off127936 00010000:00010000:1.0:1777580313.286062:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286092:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286107:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286118:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286125:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286131:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286199:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580313.286230:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286236:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286401:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286408:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.286413:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286422:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286452:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa400) 00010000:00010000:1.0:1777580313.286455:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580313.286460:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286466:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3a3 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286494:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286500:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286506:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286512:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.286514:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286521:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286528:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.286531:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.286534:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.286540:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b395 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.286560:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f0499b7e reply state 0000000013f1ab84 transno 8589950762 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.286570:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.286694:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283096:x1863919946671360:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4087us (4689us total) trans 8589950762 rc 0/0 00000100:00100000:1.0:1777580313.286706:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19535 00000100:00100000:1.0:1777580313.286715:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834197543368 time 7834231451161 state 0x2 ref 0 00010000:00010000:1.0:1777580313.287579:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580313.287591:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.287603:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580313.287606:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.287615:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.287631:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f1:0x0].0x0 (ffffa024185aa400) 00010000:00010000:1.0:1777580313.287635:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580313.287639:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.287645:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3aa lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.287668:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580313.287670:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580313.287684:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580313.330682:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.330719:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946671616 00000100:00100000:0.0:1777580313.330731:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946671616 00000100:00100000:0.0:1777580313.330778:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834197543368 time 7834231451161 state 0x0 ref 1 00000100:00100000:0.0:1777580313.330792:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834231551161 time 7834231451161 state 0x1 ref 1 00000100:00100000:0.0:1777580313.330829:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834231551161 time 7834279682331 state 0x0 ref 1 00000100:00100000:0.0:1777580313.330843:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283089:x1863919946671616:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.330925:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.330962:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b165 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5e2 expref: 387 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331006:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4af7b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e595 expref: 386 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331019:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa024993df600) 00010000:00010000:0.0:1777580313.331031:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.331059:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331075:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331085:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331102:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331109:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331115:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331306:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331315:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331322:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.331887:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1875, 64 off128192 00010000:00010000:0.0:1777580313.331966:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331977:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331986:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331993:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.331999:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332006:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332030:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.332053:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332059:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332066:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332073:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.332077:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332093:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332104:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa02498977600) 00010000:00010000:0.0:1777580313.332106:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.332110:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332116:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b3bf lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332153:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332160:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332166:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332171:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.332174:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332179:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332186:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.332189:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.332192:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332206:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b3b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.332217:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b1efc872 reply state 000000002ed7795a transno 8589950763 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.332226:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.332320:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283089:x1863919946671616:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1476us (1647us total) trans 8589950763 rc 0/0 00000100:00100000:0.0:1777580313.332330:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19536 00000100:00100000:0.0:1777580313.332338:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834231551161 time 7834279682331 state 0x2 ref 0 00010000:00010000:0.0:1777580313.332386:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.332392:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332398:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.332402:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332408:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332417:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ee:0x0].0x0 (ffffa02498977600) 00010000:00010000:0.0:1777580313.332420:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.332422:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332428:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b3c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.332452:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.332454:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.332456:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580313.339703:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.339727:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.339737:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.339743:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.339761:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.339771:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.343166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.343588:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946671744 00000100:00100000:1.0:1777580313.343601:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946671744 00000100:00100000:1.0:1777580313.343648:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834231551161 time 7834279682331 state 0x0 ref 1 00000100:00100000:1.0:1777580313.343664:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834279782331 time 7834279682331 state 0x1 ref 1 00000100:00100000:1.0:1777580313.343696:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834279782331 time 7834292558578 state 0x0 ref 1 00000100:00100000:1.0:1777580313.343709:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283120:x1863919946671744:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.343737:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.343762:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e683 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343856:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343874:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343886:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343903:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343909:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.343916:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344065:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344073:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344079:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.344113:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f5:0x0]: returning size 0 00000004:00200000:1.0:1777580313.344118:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.344169:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344182:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344190:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344196:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344204:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344209:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.344213:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344220:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.344240:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.345085:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345098:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345105:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345111:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.345115:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345121:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345151:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02498977000) 00010000:00010000:0.0:1777580313.345155:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.345160:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.345167:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b3b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.345896:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024185aa600) 00010000:00010000:2.0:1777580313.345904:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.345910:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.345918:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b39c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349094:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.349109:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349122:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b3d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349161:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349169:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349175:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349182:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.349187:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349194:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349212:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa024185aa400) 00010000:00010000:1.0:1777580313.349216:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.349219:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349225:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b3db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349330:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b3cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e683 expref: 387 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349348:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e683 expref: 386 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.349356:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02481646b00) 00010000:00010000:1.0:1777580313.349358:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.349361:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1c00, rc 0) 00000100:00100000:1.0:1777580313.349456:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283120:x1863919946671744:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5747us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.349467:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19537 00000100:00100000:1.0:1777580313.349477:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834279782331 time 7834292558578 state 0x2 ref 0 00000100:00100000:1.0:1777580313.349646:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349813:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.349852:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946671872 00000100:00100000:1.0:1777580313.349863:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946671872 00000100:00100000:1.0:1777580313.349897:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834279782331 time 7834292558578 state 0x0 ref 1 00000100:00100000:1.0:1777580313.349910:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834292658578 time 7834292558578 state 0x1 ref 1 00000100:00100000:1.0:1777580313.349925:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672000 00000100:00100000:1.0:1777580313.349935:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672000 00000100:00100000:1.0:1777580313.349949:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834292658578 time 7834292558578 state 0x1 ref 2 00000100:00100000:1.0:1777580313.349961:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672128 00000100:00100000:1.0:1777580313.349963:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672128 00000100:00100000:1.0:1777580313.349975:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834292658578 time 7834292558578 state 0x1 ref 3 00000100:00100000:1.0:1777580313.349983:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834298946614 time 7834298846614 state 0x1 ref 3 00000100:00100000:1.0:1777580313.349995:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283118:x1863919946671872:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.350014:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.350031:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b3e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e68a expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350098:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350114:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350125:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350163:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350170:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350177:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350321:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350330:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350337:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.350371:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f4:0x0]: returning size 0 00000004:00200000:1.0:1777580313.350376:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.350399:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350411:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350418:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350423:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350429:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350434:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.350438:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350445:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350463:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.350466:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.350470:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350476:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b3f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350488:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350494:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350500:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350505:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.350508:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350513:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350519:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024185aa500) 00010000:00010000:1.0:1777580313.350521:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.350523:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350529:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b3f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350566:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b3e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e68a expref: 390 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350578:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e68a expref: 389 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350585:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa02484c59800) 00010000:00010000:1.0:1777580313.350587:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.350590:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:1.0:1777580313.350642:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283118:x1863919946671872:12345-192.168.202.9@tcp:101:rm.500 Request processed in 648us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.350649:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19538 00000100:00100000:1.0:1777580313.350666:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672256 00000100:00100000:1.0:1777580313.350670:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672256 00000100:00100000:1.0:1777580313.350686:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834298946614 time 7834298846614 state 0x1 ref 3 00000100:00100000:1.0:1777580313.350693:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672384 00000100:00100000:1.0:1777580313.350696:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672384 00000100:00100000:1.0:1777580313.350704:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834298946614 time 7834298846614 state 0x1 ref 4 00000100:00100000:1.0:1777580313.350710:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672512 00000100:00100000:1.0:1777580313.350713:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672512 00000100:00100000:1.0:1777580313.350721:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834298946614 time 7834298846614 state 0x1 ref 5 00000100:00100000:1.0:1777580313.350731:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834299695286 time 7834299595286 state 0x1 ref 5 00000100:00100000:1.0:1777580313.350741:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283124:x1863919946672000:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.350751:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.350766:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b405 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e691 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350798:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350806:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.350814:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354769:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354796:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354811:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354972:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354981:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.354989:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.355029:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f6:0x0]: returning size 0 00000004:00200000:1.0:1777580313.355033:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.355057:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355083:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355093:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355100:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355108:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355115:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.355119:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355127:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355157:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.355161:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.355166:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355174:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b40c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355187:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355194:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355206:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355211:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.355214:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355220:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355226:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024185aac00) 00010000:00010000:1.0:1777580313.355229:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.355231:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355237:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4b413 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355294:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b405 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e691 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355310:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e691 expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355318:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481358500) 00010000:00010000:1.0:1777580313.355321:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.355323:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:1.0:1777580313.355418:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283124:x1863919946672000:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4675us (5680us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.355437:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19539 00000100:00100000:1.0:1777580313.355485:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834304444963 time 7834304344963 state 0x1 ref 4 00000100:00100000:1.0:1777580313.355502:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283125:x1863919946672128:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.355521:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.355533:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b421 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e698 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355585:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355595:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355603:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355616:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355623:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355630:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355690:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355698:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355710:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.355732:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f7:0x0]: returning size 0 00000004:00200000:1.0:1777580313.355735:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.355744:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355752:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355760:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355766:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355773:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355778:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.355781:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355786:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355794:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.355797:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.355800:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355815:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b428 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355840:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355844:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355850:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355854:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.355857:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355862:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355868:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024ae57bd00) 00010000:00010000:1.0:1777580313.355870:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.355872:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355877:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b42f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355900:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b421 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e698 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355922:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e698 expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.355929:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02498977c00) 00010000:00010000:1.0:1777580313.355931:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.355933:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ba00, rc 0) 00000100:00100000:1.0:1777580313.355960:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283125:x1863919946672128:12345-192.168.202.9@tcp:101:rm.500 Request processed in 464us (6204us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.355966:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19540 00000100:00100000:1.0:1777580313.355984:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834304946736 time 7834304846736 state 0x1 ref 3 00000100:00100000:1.0:1777580313.355993:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283117:x1863919946672256:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.356002:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.356010:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b43d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e69f expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356041:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356049:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356056:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356067:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356083:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356090:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356175:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356184:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356192:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.356209:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f3:0x0]: returning size 0 00000004:00200000:1.0:1777580313.356211:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.356220:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356228:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356236:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356243:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356249:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356264:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.356267:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356274:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356283:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.356285:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.356288:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356294:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b444 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356305:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356311:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356318:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356324:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.356327:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356334:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356352:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024ae57b600) 00010000:00010000:1.0:1777580313.356355:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.356358:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356365:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b44b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356390:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b43d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e69f expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356402:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e69f expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356409:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa024185aa100) 00010000:00010000:1.0:1777580313.356411:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.356413:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc7600, rc 0) 00000100:00100000:1.0:1777580313.356438:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283117:x1863919946672256:12345-192.168.202.9@tcp:101:rm.500 Request processed in 445us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.356445:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19541 00000100:00100000:1.0:1777580313.356462:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305424900 time 7834305324900 state 0x1 ref 2 00000100:00100000:1.0:1777580313.356473:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283126:x1863919946672384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.356482:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.356491:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b459 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6a6 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356536:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356544:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356552:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356563:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356569:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356576:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356628:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356637:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356644:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.356664:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f8:0x0]: returning size 0 00000004:00200000:1.0:1777580313.356666:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.356676:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356694:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356701:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356706:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356712:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356717:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.356719:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356725:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356732:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.356734:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.356737:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356742:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b460 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356752:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356758:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356769:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356775:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.356778:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356784:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356792:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024ae57b500) 00010000:00010000:1.0:1777580313.356794:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.356797:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356803:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b467 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356843:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b459 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6a6 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356855:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6a6 expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.356861:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:1.0:1777580313.356864:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.356866:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:1.0:1777580313.356893:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283126:x1863919946672384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 421us (7100us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.356909:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19542 00000100:00100000:1.0:1777580313.356928:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305424900 time 7834305791331 state 0x0 ref 1 00000100:00100000:1.0:1777580313.356939:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283110:x1863919946672512:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.356948:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.356957:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b475 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6ad expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357005:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357013:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357021:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357034:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357041:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357047:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357096:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357105:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357120:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.357183:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f2:0x0]: returning size 0 00000004:00200000:1.0:1777580313.357186:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.357198:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357206:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357214:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357221:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357226:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357231:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.357234:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357241:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357249:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.357252:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.357254:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357271:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b47c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357282:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357288:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357294:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357300:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.357303:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357309:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357316:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024ae57be00) 00010000:00010000:1.0:1777580313.357319:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.357321:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357326:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2a00/0xcb2b2f2f7e4b483 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357349:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b475 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ad expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357372:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ad expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.357378:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa024993df300) 00010000:00010000:1.0:1777580313.357381:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.357384:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249dea2600, rc 0) 00000100:00100000:1.0:1777580313.357411:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283110:x1863919946672512:12345-192.168.202.9@tcp:101:rm.500 Request processed in 472us (7596us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.357418:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19543 00000100:00100000:1.0:1777580313.357423:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305424900 time 7834305791331 state 0x2 ref 0 00000100:00100000:2.0:1777580313.372775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580313.372895:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.373182:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672640 00000100:00100000:3.0:1777580313.373195:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672640 00000100:00100000:3.0:1777580313.373253:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672768 00000100:00100000:3.0:1777580313.373255:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672768 00000100:00100000:3.0:1777580313.373286:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11946 00000100:00100000:3.0:1777580313.373354:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2363:x1863919946672640:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:0.0:1777580313.373366:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11947 00000100:00100000:0.0:1777580313.373377:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946672768:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580313.373380:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.373395:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.373409:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6b4 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.373409:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6bb expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580313.373442:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b2:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00002000:00010000:0.0:1777580313.373442:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d6:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:3.0:1777580313.373465:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.373465:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.373468:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.373468:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.373478:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 28 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.373478:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 25 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.373498:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 25 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.373501:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 28 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.373513:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c200, rc 0) 00010000:00010000:0.0:1777580313.373513:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838400, rc 0) 00000100:00100000:3.0:1777580313.373589:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2363:x1863919946672640:12345-192.168.202.9@tcp:101:rm.500 Request processed in 295us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.373596:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11946 00000100:00100000:0.0:1777580313.373968:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946672768:12345-192.168.202.9@tcp:101:rm.500 Request processed in 593us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.373976:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11947 00000100:00100000:0.0:1777580313.381080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.381119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.381165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.381486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.394359:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.395005:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673024 00000100:00100000:3.0:1777580313.395019:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673024 00000100:00100000:3.0:1777580313.395101:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673152 00000100:00100000:3.0:1777580313.395104:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673152 00000100:00100000:3.0:1777580313.395131:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946672896 00000100:00100000:3.0:1777580313.395156:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946672896 00000100:00100000:3.0:1777580313.395175:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673408 00000100:00100000:3.0:1777580313.395178:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673408 00000100:00100000:3.0:1777580313.395203:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11948 00000100:00100000:3.0:1777580313.395215:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2364:x1863919946673024:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580313.395241:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.395271:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6c9 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580313.396521:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b1:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:3.0:1777580313.396553:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.396556:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.396572:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 30 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.396624:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 30 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.396641:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1d200, rc 0) 00000100:00100000:3.0:1777580313.396736:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2364:x1863919946673024:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1523us (15669us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.396746:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11948 00000100:00100000:3.0:1777580313.396794:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11949 00000100:00100000:3.0:1777580313.396806:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946673152:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580313.396832:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.396857:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6d0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580313.396878:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d8:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:3.0:1777580313.396889:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.396891:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.396896:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 27 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.396909:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 27 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.396918:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1d600, rc 0) 00000100:00100000:3.0:1777580313.396938:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946673152:12345-192.168.202.9@tcp:101:rm.500 Request processed in 137us (15819us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.396953:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11949 00000100:00100000:3.0:1777580313.396971:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11950 00000100:00100000:3.0:1777580313.396977:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2361:x1863919946672896:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580313.396986:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.396996:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6c2 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580313.397010:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d7:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:3.0:1777580313.397019:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.397021:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.397025:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 27 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.397036:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 27 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.397045:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1da00, rc 0) 00000100:00100000:3.0:1777580313.397066:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2361:x1863919946672896:12345-192.168.202.9@tcp:101:rm.500 Request processed in 90us (15900us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.397072:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11950 00000100:00100000:3.0:1777580313.397087:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11951 00000100:00100000:3.0:1777580313.397093:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946673408:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580313.397101:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.397112:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6de expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580313.397155:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b3:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:3.0:1777580313.397166:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.397167:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580313.397172:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 30 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.397183:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 30 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.397191:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b4a1c800, rc 0) 00000100:00100000:3.0:1777580313.397212:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946673408:12345-192.168.202.9@tcp:101:rm.500 Request processed in 119us (15727us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.397218:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11951 00000100:00100000:0.0:1777580313.407595:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673280 00000100:00100000:0.0:1777580313.407614:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673280 00000100:00100000:0.0:1777580313.407684:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11952 00000100:00100000:0.0:1777580313.407694:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2361:x1863919946673280:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580313.407735:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.407764:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6d7 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580313.407798:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d5:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:0.0:1777580313.407835:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.407838:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.407850:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 28 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.407868:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 28 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.407882:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839800, rc 0) 00000100:00100000:0.0:1777580313.407973:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946673280:12345-192.168.202.9@tcp:101:rm.500 Request processed in 280us (13629us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.407981:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11952 00000100:00100000:0.0:1777580313.408090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.408664:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673664 00000100:00100000:0.0:1777580313.408671:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673664 00000100:00100000:0.0:1777580313.408700:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305424900 time 7834305791331 state 0x0 ref 1 00000100:00100000:0.0:1777580313.408712:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305891331 time 7834305791331 state 0x1 ref 1 00000100:00100000:0.0:1777580313.408735:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305891331 time 7834357597742 state 0x0 ref 1 00000100:00100000:0.0:1777580313.408745:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283120:x1863919946673664:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.408932:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.408961:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b3e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e683 expref: 392 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.408986:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b2c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e659 expref: 391 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.408996:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02481646b00) 00010000:00010000:0.0:1777580313.409007:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.409030:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409044:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409055:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409069:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409075:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409081:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409240:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409260:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.409273:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.412800:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1872, 64 off128000 00010000:00010000:0.0:1777580313.412913:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.412935:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.412951:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.412962:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.412969:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.412976:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413004:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.413033:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413039:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413046:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413067:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.413072:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413081:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413095:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580313.413098:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.413104:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413111:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b4d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413158:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413165:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413171:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413176:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.413179:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413185:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413204:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.413206:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.413209:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.413214:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b4c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.413226:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002083aeb5 reply state 0000000064d9aedc transno 8589950764 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.413237:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.413356:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283120:x1863919946673664:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4606us (5261us total) trans 8589950764 rc 0/0 00000100:00100000:0.0:1777580313.413368:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19544 00000100:00100000:0.0:1777580313.413378:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305891331 time 7834357597742 state 0x2 ref 0 00010000:00010000:0.0:1777580313.415556:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.415570:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.415581:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.415586:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.415596:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.415613:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f5:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580313.415616:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.415631:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.415637:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b4d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.415664:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.415666:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.415668:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580313.431202:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.431241:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946673920 00000100:00100000:0.0:1777580313.431260:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946673920 00000100:00100000:0.0:1777580313.431308:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834305891331 time 7834357597742 state 0x0 ref 1 00000100:00100000:0.0:1777580313.431324:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834357697742 time 7834357597742 state 0x1 ref 1 00000100:00100000:0.0:1777580313.431360:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834357697742 time 7834380220594 state 0x0 ref 1 00000100:00100000:0.0:1777580313.431374:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283118:x1863919946673920:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.431468:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.431502:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b3fe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e68a expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431521:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b268 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e644 expref: 391 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431533:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa02484c59800) 00010000:00010000:0.0:1777580313.431544:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.431574:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431608:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431620:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431638:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431644:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431650:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431810:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431828:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.431836:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.432432:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1876, 64 off128256 00010000:00010000:0.0:1777580313.432508:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432520:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432529:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432545:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432552:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432559:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432582:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.432607:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432614:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432621:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432628:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.432632:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432639:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432649:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa02481646400) 00010000:00010000:0.0:1777580313.432652:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.432655:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432671:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b4ec lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432693:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432699:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432704:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432710:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.432713:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432718:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432727:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.432729:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.432732:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.432738:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b4de lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.432748:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e2519a8a reply state 00000000d24bf39e transno 8589950765 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.432757:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.432889:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283118:x1863919946673920:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1514us (1699us total) trans 8589950765 rc 0/0 00000100:00100000:0.0:1777580313.432899:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19545 00000100:00100000:0.0:1777580313.432907:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834357697742 time 7834380220594 state 0x2 ref 0 00010000:00010000:0.0:1777580313.434752:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.434769:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.434783:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.434873:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.434886:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.434905:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f4:0x0].0x0 (ffffa02481646400) 00010000:00010000:0.0:1777580313.434908:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.434914:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.434921:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b4f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.434945:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.434947:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.434949:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.436681:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436700:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436708:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436714:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.436720:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436727:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436749:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02498977100) 00010000:00010000:3.0:1777580313.436752:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.436756:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.436763:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.457935:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.458356:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458374:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458383:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458391:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.458406:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458417:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458461:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02484c59100) 00010000:00010000:1.0:1777580313.458465:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.458470:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.458477:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b4e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.458999:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946674176 00000100:00100000:3.0:1777580313.459015:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946674176 00000100:00100000:3.0:1777580313.459067:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834357697742 time 7834380220594 state 0x0 ref 1 00000100:00100000:3.0:1777580313.459100:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834380320594 time 7834380220594 state 0x1 ref 1 00000100:00100000:3.0:1777580313.459128:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834380320594 time 7834407990184 state 0x0 ref 1 00000100:00100000:3.0:1777580313.459167:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283124:x1863919946674176:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580313.459278:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580313.459320:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b41a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e691 expref: 390 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459343:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b2f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e667 expref: 389 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459354:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa02481358500) 00010000:00010000:3.0:1777580313.459363:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.459396:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459424:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459435:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459454:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459462:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459468:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459623:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459632:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.459640:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580313.460268:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1877, 64 off128320 00010000:00010000:3.0:1777580313.460344:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460355:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460363:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460378:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460385:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460391:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460410:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580313.460435:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460441:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460447:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460453:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.460458:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460466:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460477:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:3.0:1777580313.460480:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580313.460483:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460498:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b508 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460517:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460524:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460528:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460533:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.460536:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460538:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580313.460541:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460545:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460549:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580313.460551:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.460551:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580313.460555:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460555:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.460561:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b4fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460562:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.460570:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dda7c71e reply state 0000000045958782 transno 8589950766 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460571:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f6:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:1.0:1777580313.460573:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580313.460575:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.460580:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.460581:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b50f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.460597:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580313.460599:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580313.460600:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580313.460703:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283124:x1863919946674176:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1543us (4474us total) trans 8589950766 rc 0/0 00000100:00100000:3.0:1777580313.460714:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19546 00000100:00100000:3.0:1777580313.460721:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834380320594 time 7834407990184 state 0x2 ref 0 00010000:00010000:1.0:1777580313.467177:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467199:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467209:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467216:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.467222:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467231:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467265:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0248e788800) 00010000:00010000:1.0:1777580313.467269:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.467274:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.467282:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b501 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.473875:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580313.474167:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946674432 00000100:00100000:2.0:1777580313.474181:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946674432 00000100:00100000:2.0:1777580313.474232:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834380320594 time 7834407990184 state 0x0 ref 1 00000100:00100000:2.0:1777580313.474261:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834408090184 time 7834407990184 state 0x1 ref 1 00000100:00100000:2.0:1777580313.474295:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834408090184 time 7834423157128 state 0x0 ref 1 00000100:00100000:2.0:1777580313.474310:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283125:x1863919946674432:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580313.474390:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580313.474438:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b436 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e698 expref: 389 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474466:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b302 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e66e expref: 388 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474498:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa02498977c00) 00010000:00010000:2.0:1777580313.474511:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580313.474544:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474563:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474576:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474594:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474603:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474610:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474769:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474778:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.474786:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580313.475411:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1873, 64 off128064 00010000:00010000:2.0:1777580313.475484:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475501:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475511:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475518:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475525:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475532:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475556:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580313.475579:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475585:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475592:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475599:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.475604:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475610:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475629:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:2.0:1777580313.475632:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580313.475635:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475641:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b524 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475662:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475668:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475673:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475677:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.475679:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475685:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475691:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580313.475693:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.475695:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.475700:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b516 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580313.475718:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a2e1d4c6 reply state 0000000060d7a6d6 transno 8589950767 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.475726:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580313.476696:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.476709:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.476720:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.476736:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.476744:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.476757:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f7:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:0.0:1777580313.476760:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.476764:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.476770:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b52b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.476884:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.476887:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.476888:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580313.478547:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283125:x1863919946674432:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4226us (4671us total) trans 8589950767 rc 0/0 00000100:00100000:2.0:1777580313.478562:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19547 00000100:00100000:2.0:1777580313.478573:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834408090184 time 7834423157128 state 0x2 ref 0 00010000:00010000:1.0:1777580313.506475:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506501:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506511:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506551:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.506557:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506566:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506589:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0249f048500) 00010000:00010000:1.0:1777580313.506592:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.506598:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.506605:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4b51d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.512983:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.517069:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946674688 00000100:00100000:0.0:1777580313.517090:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946674688 00000100:00100000:0.0:1777580313.519980:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834408090184 time 7834423157128 state 0x0 ref 1 00000100:00100000:0.0:1777580313.520003:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834423257128 time 7834423157128 state 0x1 ref 1 00000100:00100000:0.0:1777580313.520352:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834423257128 time 7834469212920 state 0x0 ref 1 00000100:00100000:0.0:1777580313.520384:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283126:x1863919946674688:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.520570:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.520608:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b46e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6a6 expref: 388 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520634:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b33a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e67c expref: 387 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520654:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:0.0:1777580313.520667:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.520698:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520715:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520726:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520742:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520749:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.520754:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.521580:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.521594:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.521601:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.525552:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1878, 64 off128384 00010000:00010000:0.0:1777580313.525674:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525713:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525729:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525739:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525746:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525753:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.525782:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.526941:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.526956:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.526963:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.526969:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.526974:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.526982:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527013:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa02481646b00) 00010000:00010000:0.0:1777580313.527016:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.527021:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527028:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b540 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527057:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527063:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527068:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527073:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.527076:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527082:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527089:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.527091:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.527094:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.527100:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b532 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.527123:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000430aed41 reply state 00000000b2afb531 transno 8589950768 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.527153:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.528574:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283126:x1863919946674688:12345-192.168.202.9@tcp:36:rm.500 Request processed in 8196us (15592us total) trans 8589950768 rc 0/0 00000100:00100000:0.0:1777580313.528591:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19548 00000100:00100000:0.0:1777580313.528602:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834423257128 time 7834469212920 state 0x2 ref 0 00010000:00010000:0.0:1777580313.528674:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.528683:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.528694:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.528699:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.528710:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.528727:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f8:0x0].0x0 (ffffa02481646b00) 00010000:00010000:0.0:1777580313.528730:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.528735:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.528741:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b547 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.528768:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.528770:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.533353:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.536292:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536316:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536326:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536334:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.536340:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536348:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536371:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02481646400) 00010000:00010000:3.0:1777580313.536375:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.536380:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.536387:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b539 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.555769:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.555837:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946674944 00000100:00100000:0.0:1777580313.555849:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946674944 00000100:00100000:0.0:1777580313.555900:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834423257128 time 7834469212920 state 0x0 ref 1 00000100:00100000:0.0:1777580313.555916:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834469312920 time 7834469212920 state 0x1 ref 1 00000100:00100000:0.0:1777580313.555947:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834469312920 time 7834504809686 state 0x0 ref 1 00000100:00100000:0.0:1777580313.555959:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283117:x1863919946674944:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.556037:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.556070:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b452 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e69f expref: 387 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556096:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b237 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e636 expref: 386 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556107:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa024185aa100) 00010000:00010000:0.0:1777580313.556118:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.556191:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556207:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556220:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556236:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556830:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556839:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.556999:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.557008:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.557015:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.558019:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1874, 64 off128128 00010000:00010000:0.0:1777580313.558102:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.558117:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.558128:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562079:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562093:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562100:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562173:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.562213:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562220:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562226:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562233:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.562237:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562245:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562261:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa02481646a00) 00010000:00010000:0.0:1777580313.562264:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.562269:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562275:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149000/0xcb2b2f2f7e4b55c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562304:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562310:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562328:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562334:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.562337:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562343:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562351:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.562354:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.562357:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.562363:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b54e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.562375:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006eb5369e reply state 00000000ebbcb006 transno 8589950769 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.562386:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.566158:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283117:x1863919946674944:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10167us (10370us total) trans 8589950769 rc 0/0 00000100:00100000:0.0:1777580313.566174:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19549 00000100:00100000:0.0:1777580313.566185:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834469312920 time 7834504809686 state 0x2 ref 0 00010000:00010000:3.0:1777580313.571941:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580313.571974:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.571988:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580313.571993:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.572004:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.572026:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f3:0x0].0x0 (ffffa02481646a00) 00010000:00010000:3.0:1777580313.572029:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580313.572034:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.572040:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b563 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.572075:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.572077:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.572079:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580313.577366:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577389:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577482:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577491:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.577497:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577523:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577545:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02481646b00) 00010000:00010000:3.0:1777580313.577549:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.577555:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.577563:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b555 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.585954:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.586360:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946675200 00000100:00100000:0.0:1777580313.586375:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946675200 00000100:00100000:0.0:1777580313.586439:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834469312920 time 7834504809686 state 0x0 ref 1 00000100:00100000:0.0:1777580313.586473:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834504909686 time 7834504809686 state 0x1 ref 1 00000100:00100000:0.0:1777580313.586502:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834504909686 time 7834535364644 state 0x0 ref 1 00000100:00100000:0.0:1777580313.586516:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283110:x1863919946675200:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580313.586597:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580313.586632:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249dea2600/0xcb2b2f2f7e4b48a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ad expref: 386 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586662:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b206 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e628 expref: 385 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586676:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa024993df300) 00010000:00010000:0.0:1777580313.586688:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.586718:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586735:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586747:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586764:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586770:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586776:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586960:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586969:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.586976:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580313.587593:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1879, 64 off128448 00010000:00010000:0.0:1777580313.587666:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587676:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587685:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587693:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587700:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587706:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587733:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580313.587758:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587775:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587782:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587789:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.587794:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587802:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587812:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580313.587815:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580313.587830:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587837:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b578 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587859:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587865:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587871:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587876:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.587883:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587890:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587897:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.587899:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.587902:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.587908:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b56a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.587918:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005c8e19ae reply state 000000006b18c33b transno 8589950770 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.587928:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.588031:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+386:283110:x1863919946675200:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1514us (2089us total) trans 8589950770 rc 0/0 00000100:00100000:0.0:1777580313.588041:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19550 00000100:00100000:0.0:1777580313.588049:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834504909686 time 7834535364644 state 0x2 ref 0 00010000:00010000:0.0:1777580313.588092:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580313.588098:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.588104:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580313.588108:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.588115:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.588130:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f2:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580313.588160:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580313.588163:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.588169:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b57f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.588183:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.588184:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580313.588186:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580313.601094:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601116:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601125:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601150:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1cc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.601157:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601166:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601195:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02481646400) 00010000:00010000:1.0:1777580313.601199:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.601205:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.601212:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b571 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.683281:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.683336:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946675456 00000100:00100000:1.0:1777580313.683350:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946675456 00000100:00100000:1.0:1777580313.683429:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834085867727 time 7834120280978 state 0x0 ref 1 00000100:00100000:1.0:1777580313.683447:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834120380978 time 7834120280978 state 0x1 ref 1 00000100:00100000:1.0:1777580313.683478:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834120380978 time 7834632340612 state 0x0 ref 1 00000100:00100000:1.0:1777580313.683491:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+61:283171:x1863919946675456:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.683524:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.683554:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b586 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6e5 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683741:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683761:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683776:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683829:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683839:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.683847:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.684483:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b4:0x0], index 1: 0 00010000:00010000:1.0:1777580313.684688:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b59b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684702:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684712:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b59b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684752:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684761:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684768:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684775:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.684780:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684800:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684832:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.684835:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.684841:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684849:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b58d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.684866:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7824cae reply state 000000005cb40d43 transno 8589950771 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.684875:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.684914:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b586 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6e5 expref: 64 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684930:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b59b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6e5 expref: 63 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.684938:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b500) 00010000:00010000:1.0:1777580313.684941:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.684943:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:1.0:1777580313.685042:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+64:283171:x1863919946675456:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1553us (1775us total) trans 8589950771 rc 0/0 00000100:00100000:1.0:1777580313.685051:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19551 00000100:00100000:1.0:1777580313.685058:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834120380978 time 7834632340612 state 0x2 ref 0 00000100:00080000:1.0:1777580313.685112:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777580313.694725:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694747:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694756:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694763:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.694769:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694778:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694810:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024ae57be00) 00010000:00010000:3.0:1777580313.694814:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.694828:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.694850:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b594 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.695656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.695701:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946675712 00000100:00100000:1.0:1777580313.695713:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946675712 00000100:00100000:1.0:1777580313.695760:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834120380978 time 7834632340612 state 0x0 ref 1 00000100:00100000:1.0:1777580313.695775:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834632440612 time 7834632340612 state 0x1 ref 1 00000100:00100000:1.0:1777580313.695812:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834632440612 time 7834644674403 state 0x0 ref 1 00000100:00100000:1.0:1777580313.695838:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283171:x1863919946675712:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.695914:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.695939:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b59b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6e5 expref: 63 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.695956:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b500) 00010000:00010000:1.0:1777580313.695965:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.696054:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.696067:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.696080:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.696699:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002178017b reply state 000000003beb9d21 transno 8589950772 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.696732:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.696922:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+64:283171:x1863919946675712:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1086us (1272us total) trans 8589950772 rc 0/0 00000100:00100000:1.0:1777580313.696932:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19552 00000100:00100000:1.0:1777580313.696938:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834632440612 time 7834644674403 state 0x2 ref 0 00000100:00100000:1.0:1777580313.723896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580313.724002:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724017:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724025:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724031:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.724038:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724046:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724067:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b600) 00010000:00010000:1.0:1777580313.724070:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.724077:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.724084:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4b5a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.724263:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946675968 00000100:00100000:2.0:1777580313.724276:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946675968 00000100:00100000:2.0:1777580313.724323:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834632440612 time 7834644674403 state 0x0 ref 1 00000100:00100000:2.0:1777580313.724337:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834644774403 time 7834644674403 state 0x1 ref 1 00000100:00100000:2.0:1777580313.724376:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834644774403 time 7834673237401 state 0x0 ref 1 00000100:00100000:2.0:1777580313.724390:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+63:283170:x1863919946675968:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580313.724427:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580313.724449:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b5b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6ec expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724631:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724647:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724658:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724686:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724694:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.724700:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580313.725359:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d9:0x0], index 0: 0 00010000:00010000:2.0:1777580313.725591:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b5c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725604:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725614:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725656:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725664:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725669:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725676:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.725680:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725698:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725712:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580313.725715:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.725719:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725726:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b5b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580313.725742:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b3a58c68 reply state 000000007b0585fd transno 8589950773 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.725752:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580313.725791:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b5b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ec expref: 66 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725808:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ec expref: 65 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.725827:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:2.0:1777580313.725830:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580313.725833:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030a00, rc 0) 00000100:00100000:2.0:1777580313.725925:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+66:283170:x1863919946675968:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1538us (2044us total) trans 8589950773 rc 0/0 00000100:00100000:2.0:1777580313.725936:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19553 00000100:00100000:2.0:1777580313.725944:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834644774403 time 7834673237401 state 0x2 ref 0 00000100:00100000:1.0:1777580313.743445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.743532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.743632:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.743677:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946676096 00000100:00100000:1.0:1777580313.743690:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946676096 00000100:00100000:1.0:1777580313.743745:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834644774403 time 7834673237401 state 0x0 ref 1 00000100:00100000:1.0:1777580313.743762:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834673337401 time 7834673237401 state 0x1 ref 1 00000100:00100000:1.0:1777580313.743791:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946676352 00000100:00100000:1.0:1777580313.743794:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946676352 00000100:00100000:1.0:1777580313.743808:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834673337401 time 7834673237401 state 0x1 ref 2 00000100:00100000:1.0:1777580313.743835:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946676608 00000100:00100000:1.0:1777580313.743838:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946676608 00000100:00100000:1.0:1777580313.743852:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834673337401 time 7834673237401 state 0x1 ref 3 00000100:00100000:1.0:1777580313.743871:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834692833920 time 7834692733920 state 0x1 ref 3 00000100:00100000:1.0:1777580313.743883:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283171:x1863919946676096:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.743916:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.743948:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b5d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6f3 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744026:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x819:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6f3 expref: 69 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744045:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x819:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6f3 expref: 69 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744090:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b500) 00010000:00010000:1.0:1777580313.744093:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580313.744097:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:1.0:1777580313.744193:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+69:283171:x1863919946676096:12345-192.168.202.9@tcp:101:touch.500 Request processed in 311us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.744202:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19554 00000100:00100000:1.0:1777580313.744225:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693188340 time 7834693088340 state 0x1 ref 2 00000100:00100000:1.0:1777580313.744234:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283170:x1863919946676352:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.744284:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.744308:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b5c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6ec expref: 68 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744329:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:1.0:1777580313.744338:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.744409:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744420:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744430:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.744610:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c8bc0288 reply state 00000000b1eb56ee transno 8589950774 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.744633:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.744697:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+69:283170:x1863919946676352:12345-192.168.202.9@tcp:36:touch.500 Request processed in 463us (1164us total) trans 8589950774 rc 0/0 00000100:00100000:1.0:1777580313.744704:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19555 00000100:00100000:1.0:1777580313.744721:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693188340 time 7834693584602 state 0x0 ref 1 00000100:00100000:1.0:1777580313.744731:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+68:283173:x1863919946676608:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.744740:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.744751:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b5e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e6fa expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744885:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744897:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744904:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744921:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744928:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.744934:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.745520:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b5:0x0], index 1: 0 00010000:00010000:1.0:1777580313.745693:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b5f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745704:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745713:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745748:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745755:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745761:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745767:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.745772:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745780:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745792:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.745795:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.745799:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745835:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4b5e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.745853:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021fdc50f reply state 000000009f9dea01 transno 8589950775 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.745861:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.745896:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b5e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6fa expref: 71 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745911:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6fa expref: 70 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.745918:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:1.0:1777580313.745920:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.745922:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:1.0:1777580313.745978:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283173:x1863919946676608:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1248us (2346us total) trans 8589950775 rc 0/0 00000100:00100000:1.0:1777580313.745988:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19556 00000100:00100000:1.0:1777580313.745995:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693188340 time 7834693584602 state 0x2 ref 0 00010000:00010000:2.0:1777580313.747192:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747209:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747215:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747221:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.747226:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747234:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747250:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0249f048900) 00010000:00010000:2.0:1777580313.747253:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.747256:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.747263:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b5be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751408:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751430:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751439:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751462:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.751469:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751477:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751499:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:2.0:1777580313.751502:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.751508:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.751514:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b5da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.771268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.771300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.771326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.771365:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.771418:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946676864 00000100:00100000:0.0:1777580313.771431:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946676864 00000100:00100000:0.0:1777580313.771481:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693188340 time 7834693584602 state 0x0 ref 1 00000100:00100000:0.0:1777580313.771496:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693684602 time 7834693584602 state 0x1 ref 1 00000100:00100000:0.0:1777580313.771518:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946677120 00000100:00100000:0.0:1777580313.771521:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946677120 00000100:00100000:0.0:1777580313.771534:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693684602 time 7834693584602 state 0x1 ref 2 00000100:00100000:0.0:1777580313.771547:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946677376 00000100:00100000:0.0:1777580313.771549:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946677376 00000100:00100000:0.0:1777580313.771559:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834693684602 time 7834693584602 state 0x1 ref 3 00000100:00100000:0.0:1777580313.771580:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834720542814 time 7834720442814 state 0x1 ref 3 00000100:00100000:0.0:1777580313.771610:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283170:x1863919946676864:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.771644:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.771675:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b604 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e701 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.771758:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b604 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e701 expref: 72 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.771775:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b604 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e701 expref: 72 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.771798:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580313.771802:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580313.771806:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:0.0:1777580313.771887:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283170:x1863919946676864:12345-192.168.202.9@tcp:101:touch.500 Request processed in 278us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.771896:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19557 00000100:00100000:0.0:1777580313.771919:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834720882216 time 7834720782216 state 0x1 ref 2 00000100:00100000:0.0:1777580313.771929:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283173:x1863919946677120:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580313.771980:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580313.772003:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b5f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6fa expref: 71 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772022:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:0.0:1777580313.772040:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580313.772113:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772123:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772167:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.772353:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e7314b97 reply state 00000000793a196b transno 8589950776 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.772364:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580313.772432:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283173:x1863919946677120:12345-192.168.202.9@tcp:36:touch.500 Request processed in 503us (1103us total) trans 8589950776 rc 0/0 00000100:00100000:0.0:1777580313.772439:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19558 00000100:00100000:0.0:1777580313.772459:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834720882216 time 7834721321796 state 0x0 ref 1 00000100:00100000:0.0:1777580313.772470:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283178:x1863919946677376:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.772480:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.772492:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b612 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e708 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772614:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772625:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772633:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772657:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772665:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.772672:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580313.773283:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15da:0x0], index 0: 0 00010000:00010000:0.0:1777580313.773477:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b627 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773491:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b627 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773500:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b627 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773541:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773549:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773556:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773562:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580313.773567:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773588:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773601:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580313.773604:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580313.773609:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773615:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b619 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580313.773633:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000474bbca2 reply state 0000000071b7724b transno 8589950777 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.773641:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580313.773679:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b612 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e708 expref: 74 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773694:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b627 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e708 expref: 73 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.773701:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa024993df300) 00010000:00010000:0.0:1777580313.773703:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580313.773706:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148800, rc 0) 00000100:00100000:0.0:1777580313.773766:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283178:x1863919946677376:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1297us (2399us total) trans 8589950777 rc 0/0 00000100:00100000:0.0:1777580313.773776:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19559 00000100:00100000:0.0:1777580313.773782:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834720882216 time 7834721321796 state 0x2 ref 0 00010000:00010000:3.0:1777580313.774990:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775008:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775015:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775022:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b4a1cc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.775027:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775035:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775051:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024ae57b000) 00010000:00010000:3.0:1777580313.775054:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.775059:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.775065:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b4a1cc00/0xcb2b2f2f7e4b5ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.775112:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946676736 00000100:00100000:3.0:1777580313.775124:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946676736 00000100:00100000:3.0:1777580313.775228:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11953 00000100:00100000:3.0:1777580313.775238:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946676736:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580313.775634:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946676736:12345-192.168.202.9@tcp:2:touch.500 Request processed in 395us (4378us total) trans 8589938614 rc 0/0 00000100:00100000:3.0:1777580313.775643:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11953 00000100:00100000:3.0:1777580313.785020:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.785167:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580313.785212:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.785227:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.785235:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580313.785369:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946677632 00000100:00100000:0.0:1777580313.785382:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946677632 00000100:00100000:0.0:1777580313.785430:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834720882216 time 7834721321796 state 0x0 ref 1 00000100:00100000:0.0:1777580313.785445:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834721421796 time 7834721321796 state 0x1 ref 1 00000100:00100000:0.0:1777580313.785471:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834721421796 time 7834734333777 state 0x0 ref 1 00000100:00100000:0.0:1777580313.785485:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283173:x1863919946677632:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.785516:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.785541:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b635 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e70f expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.785615:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b635 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e70f expref: 74 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.785633:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b635 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e70f expref: 74 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.785655:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa02484c59800) 00010000:00010000:0.0:1777580313.785658:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580313.785662:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149c00, rc 0) 00000100:00100000:0.0:1777580313.785730:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283173:x1863919946677632:12345-192.168.202.9@tcp:101:touch.500 Request processed in 247us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.785737:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19560 00000100:00100000:0.0:1777580313.785742:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834721421796 time 7834734333777 state 0x2 ref 0 00010000:00010000:3.0:1777580313.786038:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.786046:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786056:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786070:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580313.786072:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.786076:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786083:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b60b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786114:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786162:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786170:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786175:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.786178:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786185:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786194:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02484c59e00) 00010000:00010000:3.0:1777580313.786197:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.786201:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.786207:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4b620 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.792223:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946677504 00000100:00100000:2.0:1777580313.792259:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946677504 00000100:00100000:2.0:1777580313.792353:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11954 00000100:00100000:2.0:1777580313.792366:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946677504:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580313.792836:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946677504:12345-192.168.202.9@tcp:2:touch.500 Request processed in 471us (7666us total) trans 8589939016 rc 0/0 00000100:00100000:2.0:1777580313.792846:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11954 00000100:00100000:3.0:1777580313.810439:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.810488:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.810566:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.810605:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946677888 00000100:00100000:3.0:1777580313.810617:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946677888 00000100:00100000:3.0:1777580313.810676:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946678272 00000100:00100000:3.0:1777580313.810678:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946678272 00000100:00100000:3.0:1777580313.810696:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4188 00000100:00100000:3.0:1777580313.810708:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283171:x1863919946677888:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580313.811239:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283171:x1863919946677888:12345-192.168.202.9@tcp:35:touch.500 Request processed in 532us (812us total) trans 8589950778 rc 0/0 00000100:00100000:3.0:1777580313.811248:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4188 00000100:00100000:3.0:1777580313.811270:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4189 00000100:00100000:3.0:1777580313.811278:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283170:x1863919946678272:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580313.811423:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283170:x1863919946678272:12345-192.168.202.9@tcp:35:touch.500 Request processed in 145us (856us total) trans 8589950779 rc 0/0 00000100:00100000:3.0:1777580313.811430:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4189 00000100:00100000:0.0:1777580313.812706:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946678016 00000100:00100000:0.0:1777580313.812734:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946678016 00000100:00100000:0.0:1777580313.812810:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11955 00000100:00100000:0.0:1777580313.812832:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946678016:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580313.813218:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946678016:12345-192.168.202.9@tcp:2:touch.500 Request processed in 398us (2727us total) trans 8589938615 rc 0/0 00000100:00100000:0.0:1777580313.813227:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11955 00000100:00100000:1.0:1777580313.822981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.829281:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946678528 00000100:00100000:3.0:1777580313.829301:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946678528 00000100:00100000:3.0:1777580313.829360:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834721421796 time 7834734333777 state 0x0 ref 1 00000100:00100000:3.0:1777580313.829378:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834734433777 time 7834734333777 state 0x1 ref 1 00000100:00100000:3.0:1777580313.829415:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834734433777 time 7834778277106 state 0x0 ref 1 00000100:00100000:3.0:1777580313.829432:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+74:283178:x1863919946678528:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580313.829505:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580313.829537:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b627 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e708 expref: 74 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.829567:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa024993df300) 00010000:00010000:3.0:1777580313.829579:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.829675:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.829712:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.829725:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.831102:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006392b799 reply state 0000000012289a61 transno 8589950780 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.831121:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580313.831293:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283178:x1863919946678528:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1863us (8322us total) trans 8589950780 rc 0/0 00000100:00100000:3.0:1777580313.831305:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19561 00000100:00100000:3.0:1777580313.831314:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834734433777 time 7834778277106 state 0x2 ref 0 00000100:00100000:3.0:1777580313.831422:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.831579:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.831608:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946678784 00000100:00100000:3.0:1777580313.831616:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946678784 00000100:00100000:3.0:1777580313.831657:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4190 00000100:00100000:3.0:1777580313.831666:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283173:x1863919946678784:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580313.831971:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283173:x1863919946678784:12345-192.168.202.9@tcp:35:touch.500 Request processed in 305us (548us total) trans 8589950781 rc 0/0 00000100:00100000:3.0:1777580313.831979:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4190 00000100:00100000:1.0:1777580313.839912:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679040 00000100:00100000:1.0:1777580313.839935:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679040 00000100:00100000:1.0:1777580313.839988:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834734433777 time 7834778277106 state 0x0 ref 1 00000100:00100000:1.0:1777580313.840008:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834778377106 time 7834778277106 state 0x1 ref 1 00000100:00100000:1.0:1777580313.840069:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834778377106 time 7834788930074 state 0x0 ref 1 00000100:00100000:1.0:1777580313.840087:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283177:x1863919946679040:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.840125:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.840185:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b643 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e716 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841035:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841059:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841073:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841089:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841096:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.841101:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841454:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841464:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841485:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841491:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.841496:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841504:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841521:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580313.841524:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.841529:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.841536:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b63c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580313.843430:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580313.843472:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679168 00000100:00100000:2.0:1777580313.843483:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679168 00000100:00100000:2.0:1777580313.843536:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834789030074 time 7834788930074 state 0x1 ref 2 00000100:00100000:2.0:1777580313.843569:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834789030074 time 7834792430954 state 0x0 ref 2 00000100:00100000:2.0:1777580313.843595:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283178:x1863919946679168:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580313.843623:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580313.843652:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b658 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e71d expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.843723:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b658 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e71d expref: 78 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.843738:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b658 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e71d expref: 78 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.843759:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa0249f048900) 00010000:00010000:2.0:1777580313.843763:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580313.843767:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030e00, rc 0) 00000004:00080000:1.0:1777580313.844576:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b6:0x0], index 1: 0 00000100:00100000:2.0:1777580313.846050:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283178:x1863919946679168:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2445us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580313.846065:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19563 00010000:00010000:1.0:1777580313.846419:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b65f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846442:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846473:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846537:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846545:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846552:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846559:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.846564:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846572:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846585:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.846588:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.846593:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846599:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b64a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.846616:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000055497070 reply state 000000003a83eb00 transno 8589950782 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.846626:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.846675:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b643 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e716 expref: 79 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846689:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e716 expref: 78 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.846696:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa024ae57b000) 00010000:00010000:1.0:1777580313.846699:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.846701:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:1.0:1777580313.846749:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283177:x1863919946679040:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6670us (15170us total) trans 8589950782 rc 0/0 00000100:00100000:1.0:1777580313.846757:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19562 00000100:00100000:1.0:1777580313.846766:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834789030074 time 7834792430954 state 0x2 ref 0 00010000:00010000:3.0:1777580313.885947:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.885972:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.885982:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.885989:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.885995:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.886036:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.886060:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024ae57b600) 00010000:00010000:3.0:1777580313.886064:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.886070:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.886077:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b651 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.886437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.886484:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.886595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.886633:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679424 00000100:00100000:1.0:1777580313.886646:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679424 00000100:00100000:1.0:1777580313.886694:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834789030074 time 7834792430954 state 0x0 ref 1 00000100:00100000:1.0:1777580313.886709:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834792530954 time 7834792430954 state 0x1 ref 1 00000100:00100000:1.0:1777580313.886727:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679680 00000100:00100000:1.0:1777580313.886730:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679680 00000100:00100000:1.0:1777580313.886741:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834504909686 time 7834535364644 state 0x0 ref 1 00000100:00100000:1.0:1777580313.886749:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834535464644 time 7834535364644 state 0x1 ref 1 00000100:00100000:1.0:1777580313.886771:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834535464644 time 7834835633386 state 0x0 ref 1 00000100:00100000:1.0:1777580313.886801:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283191:x1863919946679680:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580313.886845:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.886869:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b66d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e724 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.886957:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.886974:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.886986:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887002:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887008:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887014:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887201:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887211:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887220:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580313.887285:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81a:0x0]: returning size 0 00000004:00200000:1.0:1777580313.887290:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580313.887314:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887328:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887337:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887345:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887350:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887357:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.887360:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887367:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887378:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.887381:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.887385:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887391:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b674 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887417:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887423:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887429:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887434:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.887437:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887442:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887450:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024ae57b400) 00010000:00010000:1.0:1777580313.887453:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.887456:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887462:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b67b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887499:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b66d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e724 expref: 81 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887514:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e724 expref: 80 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887533:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580313.887535:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.887538:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00000100:00100000:1.0:1777580313.887616:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283191:x1863919946679680:12345-192.168.202.9@tcp:101:rm.500 Request processed in 818us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580313.887625:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19565 00000100:00100000:1.0:1777580313.887631:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834535464644 time 7834835633386 state 0x2 ref 0 00000100:00100000:1.0:1777580313.887666:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834792530954 time 7834836529558 state 0x0 ref 1 00000100:00100000:1.0:1777580313.887678:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283177:x1863919946679424:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580313.887714:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580313.887727:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b65f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e716 expref: 79 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887738:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa024ae57b000) 00010000:00010000:1.0:1777580313.887745:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580313.887812:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887834:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.887842:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.888001:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004f68cfcc reply state 000000007fba6998 transno 8589950783 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.888019:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580313.888070:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283177:x1863919946679424:12345-192.168.202.9@tcp:36:touch.500 Request processed in 393us (1639us total) trans 8589950783 rc 0/0 00000100:00100000:1.0:1777580313.888077:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19564 00000100:00100000:1.0:1777580313.888080:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834792530954 time 7834836529558 state 0x2 ref 0 00000100:00100000:3.0:1777580313.888760:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679552 00000100:00100000:3.0:1777580313.888774:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679552 00000100:00100000:3.0:1777580313.888896:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11956 00000100:00100000:3.0:1777580313.888907:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946679552:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580313.889290:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946679552:12345-192.168.202.9@tcp:2:touch.500 Request processed in 385us (2694us total) trans 8589939017 rc 0/0 00000100:00100000:3.0:1777580313.889299:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11956 00010000:00010000:3.0:1777580313.914920:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.914946:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.914955:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.914961:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.914968:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.914993:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.915015:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:3.0:1777580313.915019:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.915025:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.915033:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4b689 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.915123:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.915504:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946679808 00000100:00100000:3.0:1777580313.915517:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946679808 00000100:00100000:3.0:1777580313.915564:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834792530954 time 7834836529558 state 0x0 ref 1 00000100:00100000:1.0:1777580313.915610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.915642:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946680064 00000100:00100000:1.0:1777580313.915646:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946680064 00000100:00100000:1.0:1777580313.915686:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4191 00000100:00100000:1.0:1777580313.915698:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283178:x1863919946680064:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580313.916308:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+81:283178:x1863919946680064:12345-192.168.202.9@tcp:35:touch.500 Request processed in 609us (696us total) trans 8589950784 rc 0/0 00000100:00100000:1.0:1777580313.916318:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4191 00000100:00100000:3.0:1777580313.922983:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834836629558 time 7834836529558 state 0x1 ref 1 00000100:00100000:3.0:1777580313.923042:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834836629558 time 7834871903315 state 0x0 ref 1 00000100:00100000:3.0:1777580313.923072:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283177:x1863919946679808:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580313.923104:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.923205:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b690 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e72b expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.923288:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b690 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e72b expref: 81 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.923307:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b690 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e72b expref: 81 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.923343:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580313.923347:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580313.923351:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838200, rc 0) 00000100:00100000:3.0:1777580313.923432:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+81:283177:x1863919946679808:12345-192.168.202.9@tcp:101:touch.500 Request processed in 375us (8316us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580313.923440:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19566 00000100:00100000:3.0:1777580313.923447:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834836629558 time 7834871903315 state 0x2 ref 0 00000100:00100000:1.0:1777580313.930250:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.930384:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580313.934720:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946680320 00000100:00100000:1.0:1777580313.934742:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946680320 00000100:00100000:1.0:1777580313.934801:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834836629558 time 7834871903315 state 0x0 ref 1 00000100:00100000:1.0:1777580313.934831:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834872003315 time 7834871903315 state 0x1 ref 1 00000100:00100000:1.0:1777580313.934862:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834872003315 time 7834883724266 state 0x0 ref 1 00000100:00100000:1.0:1777580313.934882:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+81:283187:x1863919946680320:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580313.934930:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580313.934963:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b697 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e732 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935215:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935236:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935250:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935268:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935275:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.935283:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580313.935872:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15db:0x0], index 0: 0 00010000:00010000:1.0:1777580313.936085:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b6ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936098:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936107:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936204:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936212:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936218:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936225:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580313.936230:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936237:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936250:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580313.936254:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580313.936259:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936265:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b69e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580313.936279:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000075095c77 reply state 000000003d560fe9 transno 8589950785 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580313.936289:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580313.936330:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4b697 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e732 expref: 84 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936361:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e732 expref: 83 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580313.936369:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:1.0:1777580313.936372:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580313.936374:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4400, rc 0) 00000100:00100000:1.0:1777580313.936473:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+84:283187:x1863919946680320:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1599us (6238us total) trans 8589950785 rc 0/0 00000100:00100000:1.0:1777580313.936483:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19567 00000100:00100000:1.0:1777580313.936490:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834872003315 time 7834883724266 state 0x2 ref 0 00000100:00100000:0.0:1777580313.941336:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946680448 00000100:00100000:0.0:1777580313.941354:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946680448 00000100:00100000:0.0:1777580313.941434:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11957 00000100:00100000:0.0:1777580313.941446:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2363:x1863919946680448:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580313.941470:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.941499:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e739 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580313.941532:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15d9:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:0.0:1777580313.941558:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.941560:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580313.941570:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 28 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.941591:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 28 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.941606:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149000, rc 0) 00000100:00100000:0.0:1777580313.941696:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946680448:12345-192.168.202.9@tcp:101:rm.500 Request processed in 252us (11311us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.941716:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11957 00000100:00100000:3.0:1777580313.952148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.952197:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946680576 00000100:00100000:3.0:1777580313.952208:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946680576 00000100:00100000:3.0:1777580313.952274:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11958 00000100:00100000:3.0:1777580313.952285:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946680576:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580313.952725:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946680576:12345-192.168.202.9@tcp:2:touch.500 Request processed in 441us (605us total) trans 8589938616 rc 0/0 00000100:00100000:3.0:1777580313.952734:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11958 00000100:00100000:3.0:1777580313.954858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.954929:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.954961:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946680832 00000100:00100000:3.0:1777580313.954972:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946680832 00000100:00100000:3.0:1777580313.955018:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834872003315 time 7834883724266 state 0x0 ref 1 00000100:00100000:3.0:1777580313.955034:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834883824266 time 7834883724266 state 0x1 ref 1 00000100:00100000:3.0:1777580313.955052:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946681088 00000100:00100000:3.0:1777580313.955055:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946681088 00000100:00100000:3.0:1777580313.955085:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834883824266 time 7834883724266 state 0x1 ref 2 00000100:00100000:3.0:1777580313.955106:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904068587 time 7834903968587 state 0x1 ref 2 00000100:00100000:3.0:1777580313.955118:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283187:x1863919946680832:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580313.955216:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580313.955249:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b6ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e732 expref: 85 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955271:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:3.0:1777580313.955281:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.955371:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955386:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955399:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.955572:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003b241cef reply state 0000000087ab5806 transno 8589950786 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.955583:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580313.955690:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283187:x1863919946680832:12345-192.168.202.9@tcp:36:touch.500 Request processed in 573us (842us total) trans 8589950786 rc 0/0 00000100:00100000:3.0:1777580313.955698:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19568 00000100:00100000:3.0:1777580313.955721:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904068587 time 7834904584048 state 0x0 ref 1 00000100:00100000:3.0:1777580313.955732:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283190:x1863919946681088:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580313.955755:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580313.955768:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b6c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e740 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955904:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955917:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955925:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955937:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955943:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.955949:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580313.956508:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b7:0x0], index 1: 0 00010000:00010000:3.0:1777580313.956684:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b6dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956695:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b6dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956704:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b6dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956756:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956763:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956769:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956775:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.956779:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956787:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956798:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580313.956801:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.956806:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956812:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b6cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.956840:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004cd22413 reply state 00000000886269fa transno 8589950787 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.956848:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580313.956881:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b6c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e740 expref: 88 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956910:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b6dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e740 expref: 87 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.956918:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa0248e788800) 00010000:00010000:3.0:1777580313.956921:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580313.956923:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838600, rc 0) 00000100:00100000:3.0:1777580313.956982:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283190:x1863919946681088:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1252us (2052us total) trans 8589950787 rc 0/0 00000100:00100000:3.0:1777580313.956992:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19569 00000100:00100000:3.0:1777580313.956998:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904068587 time 7834904584048 state 0x2 ref 0 00010000:00010000:2.0:1777580313.957857:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957867:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957873:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957878:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580313.957881:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957898:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957911:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024ae57b000) 00010000:00010000:2.0:1777580313.957914:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580313.957918:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580313.957925:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b6a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978636:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978654:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978662:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978668:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.978674:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978682:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978703:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa0248e788000) 00010000:00010000:3.0:1777580313.978720:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.978726:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.978733:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b6c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979079:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979087:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979093:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979098:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580313.979101:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979107:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979116:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa0248e788600) 00010000:00010000:3.0:1777580313.979118:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580313.979122:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.979127:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.985665:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580313.985722:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946681344 00000100:00100000:3.0:1777580313.985734:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946681344 00000100:00100000:3.0:1777580313.985806:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4192 00000100:00100000:3.0:1777580313.985827:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283177:x1863919946681344:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580313.988532:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283177:x1863919946681344:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2702us (2868us total) trans 8589950788 rc 0/0 00000100:00100000:3.0:1777580313.988549:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4192 00000100:00100000:0.0:1777580313.993635:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.993687:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580313.993732:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946681472 00000100:00100000:0.0:1777580313.993745:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946681472 00000100:00100000:0.0:1777580313.993801:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904068587 time 7834904584048 state 0x0 ref 1 00000100:00100000:0.0:1777580313.993826:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904684048 time 7834904584048 state 0x1 ref 1 00000100:00100000:0.0:1777580313.993851:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946681728 00000100:00100000:0.0:1777580313.993854:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946681728 00000100:00100000:0.0:1777580313.993867:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834904684048 time 7834904584048 state 0x1 ref 2 00000100:00100000:0.0:1777580313.993889:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834942851614 time 7834942751614 state 0x1 ref 2 00000100:00100000:0.0:1777580313.993903:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+87:283187:x1863919946681472:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580313.993937:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580313.993967:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b6eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e747 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.994052:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b6eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e747 expref: 88 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.994071:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b6eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e747 expref: 88 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580313.994094:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:0.0:1777580313.994114:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580313.994118:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000100:00100000:0.0:1777580313.994228:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283187:x1863919946681472:12345-192.168.202.9@tcp:101:touch.500 Request processed in 326us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580313.994236:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19570 00000100:00100000:3.0:1777580313.994359:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834942851614 time 7834943219971 state 0x0 ref 1 00000100:00100000:3.0:1777580313.994375:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283190:x1863919946681728:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580313.994428:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580313.994452:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b6dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e740 expref: 88 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.994470:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa0248e788800) 00010000:00010000:3.0:1777580313.994481:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580313.994552:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.994564:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580313.994572:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580313.994755:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000045645ce1 reply state 000000001c54d93d transno 8589950789 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580313.994779:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580313.994860:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+89:283190:x1863919946681728:12345-192.168.202.9@tcp:36:touch.500 Request processed in 489us (1172us total) trans 8589950789 rc 0/0 00000100:00100000:3.0:1777580313.994868:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19571 00000100:00100000:3.0:1777580313.994873:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834942851614 time 7834943219971 state 0x2 ref 0 00000100:00100000:3.0:1777580314.006044:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.006193:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946681984 00000100:00100000:0.0:1777580314.006207:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946681984 00000100:00100000:0.0:1777580314.006258:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834942851614 time 7834943219971 state 0x0 ref 1 00000100:00100000:0.0:1777580314.006275:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834943319971 time 7834943219971 state 0x1 ref 1 00000100:00100000:0.0:1777580314.006307:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834943319971 time 7834955168979 state 0x0 ref 1 00000100:00100000:0.0:1777580314.006320:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283206:x1863919946681984:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.006346:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.006373:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b6f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e74e expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006565:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006583:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006598:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006616:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006639:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.006647:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580314.007296:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15dc:0x0], index 0: 0 00010000:00010000:0.0:1777580314.007514:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b70e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007527:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b70e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007537:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b70e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007580:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007588:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007595:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007603:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.007608:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007616:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007642:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.007645:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.007651:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007659:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b700 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.007676:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ca6ff577 reply state 000000008c64b1b6 transno 8589950790 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.007685:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580314.007725:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4b6f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e74e expref: 91 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007741:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b70e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e74e expref: 90 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.007749:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa02493ac1500) 00010000:00010000:0.0:1777580314.007752:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580314.007755:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:0.0:1777580314.007867:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+91:283206:x1863919946681984:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1549us (1837us total) trans 8589950790 rc 0/0 00000100:00100000:0.0:1777580314.007877:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19572 00000100:00100000:0.0:1777580314.007884:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834943319971 time 7834955168979 state 0x2 ref 0 00000100:00100000:3.0:1777580314.021364:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.021479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.021512:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021527:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021538:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021545:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.021550:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021556:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021577:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580314.021580:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.021588:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.021691:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4b707 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021807:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021837:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021843:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021849:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.021852:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021859:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021869:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa0248e788600) 00010000:00010000:0.0:1777580314.021871:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.021875:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.021881:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b6f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.021919:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946682240 00000100:00100000:0.0:1777580314.021932:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946682240 00000100:00100000:0.0:1777580314.021975:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834943319971 time 7834955168979 state 0x0 ref 1 00000100:00100000:0.0:1777580314.021990:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834955268979 time 7834955168979 state 0x1 ref 1 00000100:00100000:0.0:1777580314.022018:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946682496 00000100:00100000:0.0:1777580314.022021:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946682496 00000100:00100000:0.0:1777580314.022033:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834955268979 time 7834955168979 state 0x1 ref 2 00000100:00100000:0.0:1777580314.022068:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834971030298 time 7834970930298 state 0x1 ref 2 00000100:00100000:0.0:1777580314.022082:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+90:283199:x1863919946682240:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.022113:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.022154:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b71c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e755 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022342:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022360:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022373:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022390:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022397:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.022404:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580314.023020:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b8:0x0], index 1: 0 00010000:00010000:0.0:1777580314.023275:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4b731 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023290:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4b731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023309:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4b731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023356:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023364:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023371:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023378:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.023382:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023390:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023401:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.023404:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.023408:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023414:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4b723 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.023430:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000036cc9939 reply state 000000001454f902 transno 8589950791 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.023440:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580314.023487:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4b71c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e755 expref: 93 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023505:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4b731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e755 expref: 92 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023513:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa02493ac1900) 00010000:00010000:0.0:1777580314.023515:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580314.023518:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f200, rc 0) 00000100:00100000:0.0:1777580314.023614:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+93:283199:x1863919946682240:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1534us (2262us total) trans 8589950791 rc 0/0 00000100:00100000:0.0:1777580314.023624:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19573 00000100:00100000:0.0:1777580314.023666:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834971030298 time 7834972526917 state 0x0 ref 1 00000100:00100000:0.0:1777580314.023680:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+92:283206:x1863919946682496:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580314.023720:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580314.023734:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4b70e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e74e expref: 92 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023745:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa02493ac1500) 00010000:00010000:0.0:1777580314.023754:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.023834:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023843:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.023850:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.023948:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a5780f2d reply state 00000000af98621a transno 8589950792 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.023956:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580314.023997:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+93:283206:x1863919946682496:12345-192.168.202.9@tcp:36:touch.500 Request processed in 321us (2518us total) trans 8589950792 rc 0/0 00000100:00100000:0.0:1777580314.024003:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19574 00000100:00100000:0.0:1777580314.024008:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834971030298 time 7834972526917 state 0x2 ref 0 00000100:00100000:0.0:1777580314.031721:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.031764:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.031905:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946682752 00000100:00100000:0.0:1777580314.031917:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946682752 00000100:00100000:0.0:1777580314.031967:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834971030298 time 7834972526917 state 0x0 ref 1 00000100:00100000:0.0:1777580314.031984:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834972626917 time 7834972526917 state 0x1 ref 1 00000100:00100000:0.0:1777580314.032013:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834972626917 time 7834980874977 state 0x0 ref 1 00000100:00100000:0.0:1777580314.032026:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+93:283190:x1863919946682752:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.032059:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.032087:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b746 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e75c expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032194:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b746 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e75c expref: 94 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032235:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b746 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e75c expref: 94 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032260:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa02498f4ad00) 00010000:00010000:0.0:1777580314.032263:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580314.032267:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:0.0:1777580314.032331:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+94:283190:x1863919946682752:12345-192.168.202.9@tcp:101:touch.500 Request processed in 307us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.032340:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19575 00000100:00100000:0.0:1777580314.032345:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834972626917 time 7834980874977 state 0x2 ref 0 00010000:00010000:0.0:1777580314.032384:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032393:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032402:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032408:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.032413:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032422:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032435:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02493ac1a00) 00010000:00010000:0.0:1777580314.032447:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.032452:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.032458:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4b72a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.032662:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946682624 00000100:00100000:3.0:1777580314.032669:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946682624 00000100:00100000:3.0:1777580314.032732:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11959 00000100:00100000:3.0:1777580314.032742:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946682624:12345-192.168.202.9@tcp:2:touch.500 00000100:00080000:1.0:1777580314.032982:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777580314.033871:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946682624:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1126us (2100us total) trans 8589939018 rc 0/0 00000100:00100000:3.0:1777580314.033882:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11959 00000100:00100000:3.0:1777580314.034090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.034172:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.034193:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.034245:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.034276:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034288:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034295:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034301:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.034306:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034313:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034339:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa02498f4a300) 00010000:00010000:3.0:1777580314.034343:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.034349:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.034358:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4b73f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.034548:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946682880 00000100:00100000:3.0:1777580314.034557:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946682880 00000100:00100000:3.0:1777580314.034592:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834535464644 time 7834835633386 state 0x0 ref 1 00000100:00100000:3.0:1777580314.034604:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834835733386 time 7834835633386 state 0x1 ref 1 00000100:00100000:3.0:1777580314.034631:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683008 00000100:00100000:3.0:1777580314.034634:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683008 00000100:00100000:3.0:1777580314.034644:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834835733386 time 7834835633386 state 0x1 ref 2 00000100:00100000:3.0:1777580314.035445:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683136 00000100:00100000:3.0:1777580314.035454:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683136 00000100:00100000:3.0:1777580314.035482:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834835733386 time 7834835633386 state 0x1 ref 3 00000100:00100000:1.0:1777580314.035550:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683392 00000100:00100000:1.0:1777580314.035556:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683392 00000100:00100000:1.0:1777580314.035576:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834972626917 time 7834980874977 state 0x0 ref 1 00000100:00100000:1.0:1777580314.035584:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834980974977 time 7834980874977 state 0x1 ref 1 00000100:00100000:1.0:1777580314.035607:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834984569122 time 7834984469122 state 0x1 ref 3 00000100:00100000:1.0:1777580314.035623:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283196:x1863919946682880:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580314.035655:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.035679:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b74d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e763 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035769:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035797:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035810:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035839:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035847:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.035855:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036000:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036009:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036016:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580314.036052:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81b:0x0]: returning size 0 00000004:00200000:1.0:1777580314.036056:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580314.036079:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036094:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036119:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036126:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036164:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036171:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.036176:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036184:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036197:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.036201:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.036206:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036213:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b754 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036231:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036238:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036261:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036273:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.036276:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036281:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036290:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024ae57be00) 00010000:00010000:1.0:1777580314.036292:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.036295:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036300:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b75b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036340:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b74d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e763 expref: 97 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036354:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e763 expref: 96 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036361:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa02484c59800) 00010000:00010000:1.0:1777580314.036363:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.036366:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4600, rc 0) 00000100:00100000:1.0:1777580314.036454:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283196:x1863919946682880:12345-192.168.202.9@tcp:101:rm.500 Request processed in 835us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.036463:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19576 00000100:00100000:1.0:1777580314.036497:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834980974977 time 7834985358812 state 0x0 ref 1 00000100:00100000:1.0:1777580314.036519:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283199:x1863919946683392:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.036560:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.036577:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4b731 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e755 expref: 95 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036592:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa02493ac1900) 00010000:00010000:1.0:1777580314.036601:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.036669:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036678:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.036685:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.036865:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ec26cec7 reply state 00000000f00a24a8 transno 8589950793 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.036875:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.036922:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283199:x1863919946683392:12345-192.168.202.9@tcp:36:touch.500 Request processed in 407us (2676us total) trans 8589950793 rc 0/0 00000100:00100000:1.0:1777580314.036929:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19579 00000100:00100000:1.0:1777580314.036934:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834980974977 time 7834985358812 state 0x2 ref 0 00000100:00100000:1.0:1777580314.036956:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985919615 time 7834985819615 state 0x1 ref 2 00000100:00100000:1.0:1777580314.036967:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283189:x1863919946683008:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580314.036988:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.037000:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b770 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e76a expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037043:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037053:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037060:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037072:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037079:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037085:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037201:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037210:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037218:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580314.037242:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x819:0x0]: returning size 0 00000004:00200000:1.0:1777580314.037252:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580314.037269:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037280:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037287:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037293:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037299:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037305:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.037308:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037315:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037324:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.037326:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.037330:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037335:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b777 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037347:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037364:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037370:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037375:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.037378:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037384:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037392:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024ae57b000) 00010000:00010000:1.0:1777580314.037394:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.037397:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037403:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b77e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037429:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b770 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e76a expref: 97 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037441:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e76a expref: 96 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037447:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b500) 00010000:00010000:1.0:1777580314.037450:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.037459:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ba00, rc 0) 00000100:00100000:1.0:1777580314.037487:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283189:x1863919946683008:12345-192.168.202.9@tcp:101:rm.500 Request processed in 522us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.037494:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19577 00000100:00100000:1.0:1777580314.037514:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985919615 time 7834986377007 state 0x0 ref 1 00000100:00100000:1.0:1777580314.037525:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283209:x1863919946683136:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580314.037535:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.037543:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b78c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e771 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037572:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037580:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037587:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037598:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037604:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037611:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037662:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037677:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037684:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580314.037704:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81c:0x0]: returning size 0 00000004:00200000:1.0:1777580314.037708:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580314.037717:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037726:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037733:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037739:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037746:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037751:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.037754:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037760:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037768:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.037775:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.037779:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037784:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b793 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037795:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037801:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037806:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037811:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.037831:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037838:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037845:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024ae57bd00) 00010000:00010000:1.0:1777580314.037847:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.037850:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037856:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b79a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037880:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b78c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e771 expref: 97 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037901:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e771 expref: 96 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.037907:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa0249f048900) 00010000:00010000:1.0:1777580314.037910:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.037912:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b200, rc 0) 00000100:00100000:1.0:1777580314.037935:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283209:x1863919946683136:12345-192.168.202.9@tcp:101:rm.500 Request processed in 413us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.037942:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19578 00000100:00100000:1.0:1777580314.037947:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985919615 time 7834986377007 state 0x2 ref 0 00000100:00100000:0.0:1777580314.055465:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.055740:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683520 00000100:00100000:3.0:1777580314.055753:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683520 00000100:00100000:3.0:1777580314.055802:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834980974977 time 7834985358812 state 0x0 ref 1 00000100:00100000:3.0:1777580314.055828:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985458812 time 7834985358812 state 0x1 ref 1 00000100:00100000:3.0:1777580314.055861:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985458812 time 7835004723413 state 0x0 ref 1 00000100:00100000:3.0:1777580314.055875:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283206:x1863919946683520:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.055925:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.055956:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b7a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e778 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.056036:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x820:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e778 expref: 97 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.056055:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x820:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e778 expref: 97 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.056076:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa0248e788800) 00010000:00010000:3.0:1777580314.056079:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.056083:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00000100:00100000:3.0:1777580314.056180:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+97:283206:x1863919946683520:12345-192.168.202.9@tcp:101:touch.500 Request processed in 307us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.056188:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19580 00000100:00100000:3.0:1777580314.056194:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985458812 time 7835004723413 state 0x2 ref 0 00010000:00010000:3.0:1777580314.065165:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065182:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065190:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065196:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.065202:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065218:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065238:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:3.0:1777580314.065253:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.065259:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.065267:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b769 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.065350:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.069614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.069649:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.069738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.070529:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683648 00000100:00100000:0.0:1777580314.070543:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683648 00000100:00100000:0.0:1777580314.070624:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684032 00000100:00100000:0.0:1777580314.070628:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684032 00000100:00100000:0.0:1777580314.070657:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11960 00000100:00100000:0.0:1777580314.070668:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946683648:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580314.071108:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946683648:12345-192.168.202.9@tcp:2:touch.500 Request processed in 440us (5762us total) trans 8589938617 rc 0/0 00000100:00100000:0.0:1777580314.071117:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11960 00000100:00100000:0.0:1777580314.071166:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11961 00000100:00100000:0.0:1777580314.071174:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946684032:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.071186:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.071210:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e77f expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580314.071236:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b5:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00000100:00080000:3.0:1777580314.072515:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777580314.072640:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.072645:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.072661:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 30 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.072716:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 30 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.072734:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fe00, rc 0) 00000100:00100000:0.0:1777580314.072803:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946684032:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1628us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.072821:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11961 00000100:00100000:3.0:1777580314.077305:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.077357:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.077434:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.077602:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684288 00000100:00100000:0.0:1777580314.077615:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684288 00000100:00100000:0.0:1777580314.077672:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684416 00000100:00100000:0.0:1777580314.077675:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684416 00000100:00100000:0.0:1777580314.077697:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11962 00000100:00100000:0.0:1777580314.077709:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946684288:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580314.078195:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946684288:12345-192.168.202.9@tcp:2:touch.500 Request processed in 487us (901us total) trans 8589939019 rc 0/0 00000100:00100000:0.0:1777580314.078204:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11962 00000100:00100000:0.0:1777580314.078229:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11963 00000100:00100000:0.0:1777580314.078238:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946684416:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.079897:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.079931:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e78d expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580314.079971:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15da:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580314.079996:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.080010:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.080024:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.080047:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.080064:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:0.0:1777580314.080127:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946684416:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1890us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.080151:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11963 00000100:00100000:1.0:1777580314.084355:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946683904 00000100:00100000:1.0:1777580314.084376:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946683904 00000100:00100000:1.0:1777580314.084467:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4193 00000100:00100000:1.0:1777580314.084479:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283187:x1863919946683904:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.084942:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+97:283187:x1863919946683904:12345-192.168.202.9@tcp:35:touch.500 Request processed in 464us (15341us total) trans 8589950794 rc 0/0 00000100:00100000:1.0:1777580314.084950:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4193 00000100:00100000:1.0:1777580314.084993:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684160 00000100:00100000:1.0:1777580314.084999:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684160 00000100:00100000:1.0:1777580314.085023:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985458812 time 7835004723413 state 0x0 ref 1 00000100:00100000:1.0:1777580314.085035:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835004823413 time 7835004723413 state 0x1 ref 1 00000100:00100000:1.0:1777580314.085056:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684800 00000100:00100000:1.0:1777580314.085059:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684800 00000100:00100000:1.0:1777580314.085086:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835004823413 time 7835004723413 state 0x1 ref 2 00000100:00100000:1.0:1777580314.085109:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034071075 time 7835033971075 state 0x1 ref 2 00000100:00100000:1.0:1777580314.085119:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283199:x1863919946684160:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.085178:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.085207:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b7bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e786 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085263:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b7bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x821:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e786 expref: 99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085280:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b7bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x821:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e786 expref: 99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085301:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:1.0:1777580314.085305:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.085309:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:1.0:1777580314.085332:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+99:283199:x1863919946684160:12345-192.168.202.9@tcp:101:touch.500 Request processed in 215us (15594us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.085339:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19581 00000100:00100000:1.0:1777580314.085355:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034071075 time 7835034218005 state 0x0 ref 1 00000100:00100000:1.0:1777580314.085363:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283201:x1863919946684800:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.085375:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.085384:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b7c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e79b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085523:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085536:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085545:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085558:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085564:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.085570:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580314.086116:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15dd:0x0], index 0: 0 00010000:00010000:1.0:1777580314.086349:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b7d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086362:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086371:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086413:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086433:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086439:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086446:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.086451:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086460:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086473:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.086476:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.086481:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086487:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b7cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.086503:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fddc8ec4 reply state 0000000080174f87 transno 8589950795 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.086513:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.086548:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b7c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e79b expref: 101 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086562:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e79b expref: 100 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.086581:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa024ae57be00) 00010000:00010000:1.0:1777580314.086583:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.086586:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ae00, rc 0) 00000100:00100000:1.0:1777580314.086648:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283201:x1863919946684800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1284us (9212us total) trans 8589950795 rc 0/0 00000100:00100000:1.0:1777580314.086657:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19582 00000100:00100000:1.0:1777580314.086663:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034071075 time 7835034218005 state 0x2 ref 0 00000100:00100000:3.0:1777580314.087396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.087538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.088203:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946685056 00000100:00100000:1.0:1777580314.088216:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946685056 00000100:00100000:1.0:1777580314.088273:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4194 00000100:00100000:1.0:1777580314.088284:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283190:x1863919946685056:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.088679:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+102:283190:x1863919946685056:12345-192.168.202.9@tcp:35:touch.500 Request processed in 395us (1138us total) trans 8589950796 rc 0/0 00000100:00100000:1.0:1777580314.088687:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4194 00000100:00100000:2.0:1777580314.099502:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946684544 00000100:00100000:2.0:1777580314.099520:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946684544 00000100:00100000:2.0:1777580314.099599:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11964 00000100:00100000:2.0:1777580314.099611:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946684544:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.099636:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.099665:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e794 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.099703:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b4:0x0] initial LVB size: 0, mtime: 0x69f3b918, atime: 0x69f3b918, ctime: 0x69f3b918, blocks: 0x1 00010000:00010000:2.0:1777580314.099731:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.099733:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.099744:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 31 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.099765:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 31 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.099800:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031c00, rc 0) 00000100:00100000:2.0:1777580314.099904:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2362:x1863919946684544:12345-192.168.202.9@tcp:101:rm.500 Request processed in 295us (12511us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.099912:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11964 00000100:00100000:1.0:1777580314.103923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.103958:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.104003:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946685440 00000100:00100000:1.0:1777580314.104015:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946685440 00000100:00100000:1.0:1777580314.104076:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4195 00000100:00100000:1.0:1777580314.104087:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+102:283206:x1863919946685440:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.104572:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283206:x1863919946685440:12345-192.168.202.9@tcp:35:touch.500 Request processed in 486us (662us total) trans 8589950797 rc 0/0 00000100:00100000:1.0:1777580314.104581:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4195 00010000:00010000:3.0:1777580314.104825:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104839:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104847:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104864:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.104870:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104878:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104898:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa024ae57b000) 00010000:00010000:3.0:1777580314.104901:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.104907:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.104914:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b7d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.104954:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946685184 00000100:00100000:3.0:1777580314.104960:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946685184 00000100:00100000:3.0:1777580314.112381:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11965 00000100:00100000:3.0:1777580314.112406:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2363:x1863919946685184:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.112879:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2363:x1863919946685184:12345-192.168.202.9@tcp:2:touch.500 Request processed in 483us (8917us total) trans 8589938618 rc 0/0 00000100:00100000:3.0:1777580314.112890:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11965 00000100:00100000:0.0:1777580314.113429:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.113590:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.113617:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946685696 00000100:00100000:0.0:1777580314.113627:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946685696 00000100:00100000:0.0:1777580314.113671:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034071075 time 7835034218005 state 0x0 ref 1 00000100:00100000:0.0:1777580314.113685:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034318005 time 7835034218005 state 0x1 ref 1 00000100:00100000:0.0:1777580314.113702:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946685952 00000100:00100000:0.0:1777580314.113705:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946685952 00000100:00100000:0.0:1777580314.113716:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835034318005 time 7835034218005 state 0x1 ref 2 00000100:00100000:0.0:1777580314.113732:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835062694973 time 7835062594973 state 0x1 ref 2 00000100:00100000:0.0:1777580314.113743:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283202:x1863919946685696:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.113766:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.113793:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b7ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7a2 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114001:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114022:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114036:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114054:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114061:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114068:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580314.114681:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b9:0x0], index 1: 0 00010000:00010000:0.0:1777580314.114912:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b803 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114926:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114935:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114978:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.114998:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115004:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115011:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.115015:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115023:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115036:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.115039:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.115044:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115051:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4b7f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.115069:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000081990f95 reply state 00000000673ffbc2 transno 8589950798 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.115078:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580314.115117:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4b7ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a2 expref: 106 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115159:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b803 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a2 expref: 105 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115178:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa024989ec400) 00010000:00010000:0.0:1777580314.115181:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580314.115183:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86600, rc 0) 00000100:00100000:0.0:1777580314.115254:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283202:x1863919946685696:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1511us (1827us total) trans 8589950798 rc 0/0 00000100:00100000:0.0:1777580314.115263:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19583 00000100:00100000:0.0:1777580314.115302:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835062694973 time 7835064163747 state 0x0 ref 1 00000100:00100000:0.0:1777580314.115317:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+105:283201:x1863919946685952:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580314.115357:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580314.115372:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b7d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e79b expref: 105 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115383:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa024ae57be00) 00010000:00010000:0.0:1777580314.115392:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.115455:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115462:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.115469:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.115559:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001055a84b reply state 00000000eca4a639 transno 8589950799 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.115578:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580314.115618:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283201:x1863919946685952:12345-192.168.202.9@tcp:36:touch.500 Request processed in 305us (2027us total) trans 8589950799 rc 0/0 00000100:00100000:0.0:1777580314.115625:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19584 00000100:00100000:0.0:1777580314.115630:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835062694973 time 7835064163747 state 0x2 ref 0 00010000:00010000:1.0:1777580314.128512:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128536:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128546:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128553:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.128558:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128567:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128587:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024989ec600) 00010000:00010000:1.0:1777580314.128591:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.128596:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.128602:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4b7fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128803:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128810:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128828:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128833:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.128839:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128846:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128855:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa0248a60eb00) 00010000:00010000:2.0:1777580314.128858:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.128861:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.128867:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b811 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.136539:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.136583:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.136674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.136711:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946686080 00000100:00100000:1.0:1777580314.136725:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946686080 00000100:00100000:1.0:1777580314.136777:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835062694973 time 7835064163747 state 0x0 ref 1 00000100:00100000:1.0:1777580314.136792:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835064263747 time 7835064163747 state 0x1 ref 1 00000100:00100000:1.0:1777580314.136842:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946686848 00000100:00100000:1.0:1777580314.136846:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946686848 00000100:00100000:1.0:1777580314.136861:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835064263747 time 7835064163747 state 0x1 ref 2 00000100:00100000:1.0:1777580314.136882:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946686336 00000100:00100000:1.0:1777580314.136885:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946686336 00000100:00100000:1.0:1777580314.136899:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835064263747 time 7835064163747 state 0x1 ref 3 00000100:00100000:1.0:1777580314.136919:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835085880791 time 7835085780791 state 0x1 ref 3 00000100:00100000:1.0:1777580314.136931:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283201:x1863919946686080:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.136965:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.136998:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b818 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7a9 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137080:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b818 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x822:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a9 expref: 107 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137097:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b818 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x822:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a9 expref: 107 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137119:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa024ae57b600) 00010000:00010000:1.0:1777580314.137122:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.137126:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b800, rc 0) 00000100:00100000:1.0:1777580314.137230:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283201:x1863919946686080:12345-192.168.202.9@tcp:101:touch.500 Request processed in 300us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.137238:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19585 00000100:00100000:1.0:1777580314.137263:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835086226526 time 7835086126526 state 0x1 ref 2 00000100:00100000:1.0:1777580314.137280:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283200:x1863919946686848:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.137293:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.137304:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b81f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7b0 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137461:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137473:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137481:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137494:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137500:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.137505:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580314.138100:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15de:0x0], index 0: 0 00010000:00010000:1.0:1777580314.138342:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b834 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138355:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138366:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138417:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138424:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138430:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138437:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.138441:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138449:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138461:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.138464:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.138468:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138475:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4b826 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.138490:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ca6a9fe0 reply state 00000000dae33aa7 transno 8589950800 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.138501:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.138540:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4b81f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b0 expref: 109 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138566:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b834 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b0 expref: 108 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138573:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:1.0:1777580314.138576:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.138578:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:1.0:1777580314.138642:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283200:x1863919946686848:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1362us (2057us total) trans 8589950800 rc 0/0 00000100:00100000:1.0:1777580314.138652:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19586 00000100:00100000:1.0:1777580314.138692:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835086226526 time 7835087554269 state 0x0 ref 1 00000100:00100000:1.0:1777580314.138707:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283202:x1863919946686336:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.138751:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.138767:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b803 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a2 expref: 108 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138783:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa024989ec400) 00010000:00010000:1.0:1777580314.138793:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.138874:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138883:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.138892:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.139000:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e7014eeb reply state 00000000804721da transno 8589950801 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.139008:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.139050:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283202:x1863919946686336:12345-192.168.202.9@tcp:36:touch.500 Request processed in 347us (2375us total) trans 8589950801 rc 0/0 00000100:00100000:1.0:1777580314.139058:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19587 00000100:00100000:1.0:1777580314.139063:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835086226526 time 7835087554269 state 0x2 ref 0 00000100:00100000:1.0:1777580314.147800:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.151566:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946686592 00000100:00100000:3.0:1777580314.151588:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946686592 00000100:00100000:3.0:1777580314.151666:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4196 00000100:00100000:3.0:1777580314.151677:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283199:x1863919946686592:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.152188:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283199:x1863919946686592:12345-192.168.202.9@tcp:35:touch.500 Request processed in 511us (4401us total) trans 8589950802 rc 0/0 00000100:00100000:3.0:1777580314.152209:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4196 00000100:00100000:1.0:1777580314.152804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.158083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.158117:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.158173:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580314.158209:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158224:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158233:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158239:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.158245:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158253:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158289:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580314.158293:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.158298:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158305:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4b842 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.158560:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946686976 00000100:00100000:1.0:1777580314.158573:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946686976 00000100:00100000:1.0:1777580314.158619:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835086226526 time 7835087554269 state 0x0 ref 1 00000100:00100000:1.0:1777580314.158634:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835087654269 time 7835087554269 state 0x1 ref 1 00000100:00100000:1.0:1777580314.158655:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946687232 00000100:00100000:1.0:1777580314.158658:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946687232 00000100:00100000:1.0:1777580314.158672:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835087654269 time 7835087554269 state 0x1 ref 2 00000100:00100000:1.0:1777580314.158685:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946687616 00000100:00100000:1.0:1777580314.158687:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946687616 00000100:00100000:1.0:1777580314.158697:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835087654269 time 7835087554269 state 0x1 ref 3 00000100:00100000:1.0:1777580314.158713:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835107675870 time 7835107575870 state 0x1 ref 3 00000100:00100000:1.0:1777580314.158724:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283202:x1863919946686976:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.158751:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.158772:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b849 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7b7 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158872:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x823:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b7 expref: 112 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158888:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x823:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b7 expref: 112 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.158910:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:1.0:1777580314.158913:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.158916:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8aa00, rc 0) 00000100:00100000:1.0:1777580314.158992:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283202:x1863919946686976:12345-192.168.202.9@tcp:101:touch.500 Request processed in 268us (6189us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.159000:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19588 00000100:00100000:1.0:1777580314.159025:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835107988907 time 7835107888907 state 0x1 ref 2 00000100:00100000:1.0:1777580314.159035:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283200:x1863919946687232:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.159099:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.159118:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b834 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b0 expref: 111 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159169:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa024ae57b400) 00010000:00010000:1.0:1777580314.159177:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.159244:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159254:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159275:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.159457:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ee9c0a6b reply state 00000000a6cfaa83 transno 8589950803 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.159469:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.159533:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283200:x1863919946687232:12345-192.168.202.9@tcp:36:touch.500 Request processed in 497us (1461us total) trans 8589950803 rc 0/0 00000100:00100000:1.0:1777580314.159540:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19589 00000100:00100000:1.0:1777580314.159559:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835107988907 time 7835108421665 state 0x0 ref 1 00000100:00100000:1.0:1777580314.159568:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283197:x1863919946687616:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.159578:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.159589:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b857 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7be expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159704:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159715:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159723:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159738:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159755:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.159763:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580314.160380:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ba:0x0], index 1: 0 00010000:00010000:1.0:1777580314.160563:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b86c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160575:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b86c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160584:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b86c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160621:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160629:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160636:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160641:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.160647:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160654:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160678:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.160681:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.160685:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160692:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b85e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.160705:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000431844da reply state 000000008d6202b9 transno 8589950804 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.160713:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.160749:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b857 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7be expref: 114 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160764:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b86c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7be expref: 113 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.160772:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:1.0:1777580314.160775:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.160778:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4400, rc 0) 00000100:00100000:3.0:1777580314.164044:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946687360 00000100:00100000:3.0:1777580314.164063:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946687360 00000100:00100000:3.0:1777580314.164166:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11966 00000100:00100000:3.0:1777580314.164179:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946687360:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580314.167977:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.167998:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.168008:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.168041:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.168049:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.168057:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.168079:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024ae57b000) 00010000:00010000:1.0:1777580314.168082:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.168088:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.168095:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b82d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.168605:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283197:x1863919946687616:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9028us (10423us total) trans 8589950804 rc 0/0 00000100:00100000:1.0:1777580314.168618:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19590 00000100:00100000:1.0:1777580314.168628:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835107988907 time 7835108421665 state 0x2 ref 0 00000100:00100000:3.0:1777580314.169761:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2361:x1863919946687360:12345-192.168.202.9@tcp:2:touch.500 Request processed in 5574us (11630us total) trans 8589939020 rc 0/0 00000100:00100000:3.0:1777580314.169776:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11966 00010000:00010000:1.0:1777580314.186987:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187010:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187019:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187026:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.187047:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187055:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187078:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa02483f8e000) 00010000:00010000:1.0:1777580314.187082:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.187088:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.187095:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b850 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.188091:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.188125:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.188169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.188189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.188211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.188923:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580314.188949:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946687744 00000100:00100000:0.0:1777580314.188962:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946687744 00000100:00100000:0.0:1777580314.189034:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11967 00000100:00100000:0.0:1777580314.189046:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946687744:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580314.189406:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189421:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189429:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189436:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.189441:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189449:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189468:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024989ec600) 00010000:00010000:1.0:1777580314.189471:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.189490:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.189498:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b865 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.189538:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946688000 00000100:00100000:1.0:1777580314.189544:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946688000 00000100:00100000:1.0:1777580314.189581:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4197 00000100:00100000:1.0:1777580314.189588:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283201:x1863919946688000:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580314.191572:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946687744:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2516us (3478us total) trans 8589938619 rc 0/0 00000100:00100000:0.0:1777580314.191587:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11967 00000100:00100000:0.0:1777580314.191642:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946688128 00000100:00100000:0.0:1777580314.191649:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946688128 00000100:00100000:0.0:1777580314.191681:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835107988907 time 7835108421665 state 0x0 ref 1 00000100:00100000:0.0:1777580314.191695:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835108521665 time 7835108421665 state 0x1 ref 1 00000100:00100000:0.0:1777580314.191718:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946688384 00000100:00100000:0.0:1777580314.191722:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946688384 00000100:00100000:0.0:1777580314.191734:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835108521665 time 7835108421665 state 0x1 ref 2 00000100:00100000:0.0:1777580314.191747:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946688640 00000100:00100000:0.0:1777580314.191749:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946688640 00000100:00100000:0.0:1777580314.191761:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834985919615 time 7834986377007 state 0x0 ref 1 00000100:00100000:1.0:1777580314.192128:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283201:x1863919946688000:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2536us (3998us total) trans 8589950805 rc 0/0 00000100:00100000:1.0:1777580314.192173:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4197 00000100:00100000:1.0:1777580314.192212:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141172569 time 7835141072569 state 0x1 ref 2 00000100:00100000:1.0:1777580314.192226:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283200:x1863919946688128:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.192483:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.192513:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b87a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7c5 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192580:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b87a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x824:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7c5 expref: 115 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192598:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b87a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x824:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7c5 expref: 115 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192619:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:1.0:1777580314.192623:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.192636:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5600, rc 0) 00000100:00100000:1.0:1777580314.192676:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283200:x1863919946688128:12345-192.168.202.9@tcp:101:touch.500 Request processed in 454us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.192685:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19591 00000100:00100000:1.0:1777580314.192708:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141172569 time 7835141571199 state 0x0 ref 1 00000100:00100000:1.0:1777580314.192718:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283197:x1863919946688384:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.192766:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.192800:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b86c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7be expref: 114 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192825:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:1.0:1777580314.192835:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.192897:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192907:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.192915:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.193065:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ebfdb926 reply state 0000000047f4405e transno 8589950806 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.193075:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.193131:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283197:x1863919946688384:12345-192.168.202.9@tcp:36:touch.500 Request processed in 413us (4940us total) trans 8589950806 rc 0/0 00000100:00100000:1.0:1777580314.193178:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19592 00000100:00100000:1.0:1777580314.193189:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141172569 time 7835141571199 state 0x2 ref 0 00000100:00100000:0.0:1777580314.195719:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834986477007 time 7834986377007 state 0x1 ref 1 00000100:00100000:0.0:1777580314.195785:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834986477007 time 7835144646748 state 0x0 ref 1 00000100:00100000:0.0:1777580314.195822:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283191:x1863919946688640:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580314.195899:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580314.195938:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b682 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e724 expref: 114 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.195967:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4b604 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e701 expref: 113 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.195982:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580314.195994:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.196023:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.196040:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.196051:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.196066:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.196073:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.196079:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.197958:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.197985:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.197998:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.198479:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.199326:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946688896 00000100:00100000:3.0:1777580314.199340:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946688896 00000100:00100000:3.0:1777580314.199411:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4198 00000100:00100000:3.0:1777580314.199422:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283202:x1863919946688896:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.201421:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283202:x1863919946688896:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1987us (2934us total) trans 8589950807 rc 0/0 00000100:00100000:3.0:1777580314.201437:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4198 00000040:00080000:0.0:1777580314.202650:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1880, 64 off128512 00000004:00080000:0.0:1777580314.202664:0:187631:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7835151528844ns, next at 7836151525865ns, rc = 0 00010000:00010000:0.0:1777580314.202766:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.202787:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.202801:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.202810:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208615:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208623:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208648:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580314.208689:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208712:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208719:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208725:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.208730:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208738:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208755:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:0.0:1777580314.208758:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580314.208764:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208770:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4b896 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208819:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208827:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208833:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208838:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.208851:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208857:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208866:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.208868:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.208871:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.208877:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4b888 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.208888:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004f9468b2 reply state 00000000081f61f9 transno 8589950808 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.208898:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580314.209027:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283191:x1863919946688640:12345-192.168.202.9@tcp:36:rm.500 Request processed in 13224us (20809us total) trans 8589950808 rc 0/0 00000100:00100000:0.0:1777580314.209039:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19593 00000100:00100000:0.0:1777580314.209049:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834986477007 time 7835144646748 state 0x2 ref 0 00010000:00010000:0.0:1777580314.209110:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580314.209117:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.209122:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.209125:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.209167:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.209182:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81a:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:0.0:1777580314.209185:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580314.209188:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.209194:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4b89d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.209210:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.209212:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.209213:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580314.212181:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580314.212604:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212622:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212630:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212636:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.212642:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212651:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212671:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:1.0:1777580314.212675:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.212680:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.212686:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b881 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.212795:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946689024 00000100:00100000:1.0:1777580314.212808:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946689024 00000100:00100000:1.0:1777580314.212864:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141172569 time 7835141571199 state 0x0 ref 1 00000100:00100000:1.0:1777580314.212878:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141671199 time 7835141571199 state 0x1 ref 1 00000100:00100000:1.0:1777580314.212912:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141671199 time 7835161774048 state 0x0 ref 1 00000100:00100000:1.0:1777580314.212940:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283197:x1863919946689024:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.212974:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.212994:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b8a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7cc expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.213069:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7cc expref: 115 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.213085:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7cc expref: 115 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.213107:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:1.0:1777580314.213109:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.213112:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4400, rc 0) 00000100:00100000:1.0:1777580314.213228:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283197:x1863919946689024:12345-192.168.202.9@tcp:101:touch.500 Request processed in 290us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.213236:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19594 00000100:00100000:1.0:1777580314.213242:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141671199 time 7835161774048 state 0x2 ref 0 00000100:00100000:3.0:1777580314.217517:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.217596:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946689152 00000100:00100000:3.0:1777580314.217608:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946689152 00000100:00100000:3.0:1777580314.217665:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11968 00000100:00100000:3.0:1777580314.217676:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946689152:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.218112:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946689152:12345-192.168.202.9@tcp:2:touch.500 Request processed in 436us (608us total) trans 8589939021 rc 0/0 00000100:00100000:3.0:1777580314.218121:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11968 00010000:00010000:1.0:1777580314.218680:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218694:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218702:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218724:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.218730:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218738:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218757:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248a60e800) 00010000:00010000:1.0:1777580314.218760:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.218766:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.218773:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4b88f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.232534:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.232701:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946689536 00000100:00100000:3.0:1777580314.232715:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946689536 00000100:00100000:3.0:1777580314.235118:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11969 00000100:00100000:3.0:1777580314.235159:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2363:x1863919946689536:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.235611:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2363:x1863919946689536:12345-192.168.202.9@tcp:2:touch.500 Request processed in 479us (3086us total) trans 8589938620 rc 0/0 00000100:00100000:3.0:1777580314.235620:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11969 00000100:00100000:3.0:1777580314.235719:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.236018:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946689408 00000100:00100000:1.0:1777580314.236029:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946689408 00000100:00100000:1.0:1777580314.236068:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835141671199 time 7835161774048 state 0x0 ref 1 00000100:00100000:1.0:1777580314.236081:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835161874048 time 7835161774048 state 0x1 ref 1 00000100:00100000:1.0:1777580314.236103:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835161874048 time 7835184965404 state 0x0 ref 1 00000100:00100000:1.0:1777580314.236114:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283211:x1863919946689408:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.236160:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.236185:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b8ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7d3 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236370:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236389:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236403:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236419:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236426:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.236433:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580314.239562:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15df:0x0], index 0: 0 00010000:00010000:1.0:1777580314.243941:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4b8c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.243972:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4b8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.243988:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4b8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244081:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244110:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244118:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244125:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.244130:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244157:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244172:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.244175:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.244181:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244187:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4b8b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.244207:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c9d9e4ca reply state 0000000039f3b6d4 transno 8589950809 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.244217:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.244281:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4b8ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7d3 expref: 117 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244298:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4b8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7d3 expref: 116 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.244317:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa024ad9fd500) 00010000:00010000:1.0:1777580314.244319:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.244322:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5000, rc 0) 00000100:00100000:1.0:1777580314.244432:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283211:x1863919946689408:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8318us (8711us total) trans 8589950809 rc 0/0 00000100:00100000:1.0:1777580314.244444:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19595 00000100:00100000:1.0:1777580314.244453:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835161874048 time 7835184965404 state 0x2 ref 0 00000100:00100000:1.0:1777580314.244572:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.244738:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946689792 00000100:00100000:1.0:1777580314.244748:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946689792 00000100:00100000:1.0:1777580314.244791:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4199 00000100:00100000:1.0:1777580314.244800:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283200:x1863919946689792:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.245252:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+118:283200:x1863919946689792:12345-192.168.202.9@tcp:35:touch.500 Request processed in 452us (680us total) trans 8589950810 rc 0/0 00000100:00100000:1.0:1777580314.245261:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4199 00000100:00100000:3.0:1777580314.248424:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.248602:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946690048 00000100:00100000:3.0:1777580314.248614:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946690048 00000100:00100000:3.0:1777580314.248670:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4200 00000100:00100000:3.0:1777580314.248681:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+118:283197:x1863919946690048:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.249295:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+119:283197:x1863919946690048:12345-192.168.202.9@tcp:35:touch.500 Request processed in 613us (882us total) trans 8589950811 rc 0/0 00000100:00100000:3.0:1777580314.249306:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4200 00010000:00010000:1.0:1777580314.249545:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249558:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249566:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249572:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.249592:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249601:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249619:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024ad9fd400) 00010000:00010000:1.0:1777580314.249623:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.249629:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.249636:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4b8b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.257620:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.257671:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.257710:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946690304 00000100:00100000:2.0:1777580314.257723:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946690304 00000100:00100000:2.0:1777580314.257772:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835161874048 time 7835184965404 state 0x0 ref 1 00000100:00100000:2.0:1777580314.257788:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835185065404 time 7835184965404 state 0x1 ref 1 00000100:00100000:2.0:1777580314.257809:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946690560 00000100:00100000:2.0:1777580314.257822:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946690560 00000100:00100000:2.0:1777580314.257838:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835185065404 time 7835184965404 state 0x1 ref 2 00000100:00100000:2.0:1777580314.257860:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835206822933 time 7835206722933 state 0x1 ref 2 00000100:00100000:2.0:1777580314.257873:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+119:283211:x1863919946690304:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580314.257956:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580314.257989:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4b8c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7d3 expref: 119 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258011:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa024ad9fd500) 00010000:00010000:2.0:1777580314.258026:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580314.258121:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258165:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258178:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.258368:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c7e80a42 reply state 00000000525ea12e transno 8589950812 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.258379:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580314.258493:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+120:283211:x1863919946690304:12345-192.168.202.9@tcp:36:touch.500 Request processed in 621us (886us total) trans 8589950812 rc 0/0 00000100:00100000:2.0:1777580314.258503:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19596 00000100:00100000:2.0:1777580314.258530:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835206822933 time 7835207392951 state 0x0 ref 1 00000100:00100000:2.0:1777580314.258542:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+119:283215:x1863919946690560:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580314.258553:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.258565:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b8d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7da expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258693:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258705:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258713:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258728:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258736:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.258757:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580314.259346:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15bb:0x0], index 1: 0 00010000:00010000:2.0:1777580314.259529:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b8ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259541:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b8ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259550:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b8ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259588:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259596:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259605:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259611:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.259616:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259624:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259636:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.259639:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.259654:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259663:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4b8dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.259680:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006422c730 reply state 0000000020007866 transno 8589950813 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.259689:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580314.259725:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4b8d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7da expref: 122 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259744:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b8ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7da expref: 121 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.259751:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:2.0:1777580314.259754:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.259756:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1c00, rc 0) 00000100:00100000:2.0:1777580314.259830:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+122:283215:x1863919946690560:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1290us (2158us total) trans 8589950813 rc 0/0 00000100:00100000:2.0:1777580314.259839:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19597 00000100:00100000:2.0:1777580314.259846:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835206822933 time 7835207392951 state 0x2 ref 0 00010000:00010000:2.0:1777580314.265935:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.265958:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.265966:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.265988:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.265993:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.266002:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.266024:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0249f048300) 00010000:00010000:2.0:1777580314.266028:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.266034:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.266042:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4b8e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266177:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266185:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266191:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266204:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.266207:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266212:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266221:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa0249f048000) 00010000:00010000:3.0:1777580314.266223:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.266227:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.266232:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4b8ce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.272321:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272373:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272418:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272443:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272517:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.272557:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946690816 00000100:00100000:2.0:1777580314.272570:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946690816 00000100:00100000:2.0:1777580314.272618:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835206822933 time 7835207392951 state 0x0 ref 1 00000100:00100000:2.0:1777580314.272634:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835207492951 time 7835207392951 state 0x1 ref 1 00000100:00100000:2.0:1777580314.272652:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946690944 00000100:00100000:2.0:1777580314.272665:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946690944 00000100:00100000:2.0:1777580314.272680:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7834986477007 time 7835144646748 state 0x0 ref 1 00000100:00100000:2.0:1777580314.272687:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 1 00000100:00100000:2.0:1777580314.272695:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691072 00000100:00100000:2.0:1777580314.272698:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691072 00000100:00100000:2.0:1777580314.272706:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 2 00000100:00100000:2.0:1777580314.272711:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691200 00000100:00100000:2.0:1777580314.272713:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691200 00000100:00100000:2.0:1777580314.272722:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 3 00000100:00100000:2.0:1777580314.272729:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691328 00000100:00100000:2.0:1777580314.272731:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691328 00000100:00100000:2.0:1777580314.272740:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 4 00000100:00100000:2.0:1777580314.272746:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691456 00000100:00100000:2.0:1777580314.272749:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691456 00000100:00100000:2.0:1777580314.272757:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 5 00000100:00100000:2.0:1777580314.272763:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691584 00000100:00100000:2.0:1777580314.272765:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691584 00000100:00100000:2.0:1777580314.272772:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835144746748 time 7835144646748 state 0x1 ref 6 00000100:00100000:2.0:1777580314.272785:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835221747305 time 7835221647305 state 0x1 ref 6 00000100:00100000:2.0:1777580314.272798:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283213:x1863919946690944:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.272845:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.272872:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b8f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7e1 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.272979:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.272996:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273011:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273028:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273034:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273041:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273218:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273228:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273236:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.273270:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81d:0x0]: returning size 0 00000004:00200000:2.0:1777580314.273274:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.273297:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273323:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273331:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273338:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273344:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273351:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.273355:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273362:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273374:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.273377:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.273382:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273388:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4b8ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273403:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273409:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273421:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273426:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.273429:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273435:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273443:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0249f048500) 00010000:00010000:2.0:1777580314.273446:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.273449:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273455:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4b906 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273492:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4b8f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 128 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273507:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 127 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273514:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580314.273516:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.273519:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0e00, rc 0) 00000100:00100000:2.0:1777580314.273591:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283213:x1863919946690944:12345-192.168.202.9@tcp:101:rm.500 Request processed in 795us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.273609:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19599 00000100:00100000:2.0:1777580314.273642:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835207492951 time 7835222503721 state 0x0 ref 1 00000100:00100000:2.0:1777580314.273654:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283215:x1863919946690816:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580314.273691:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580314.273705:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4b8ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7da expref: 126 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273715:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:2.0:1777580314.273722:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580314.273787:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273797:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.273804:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.273968:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a11e34a3 reply state 0000000015677862 transno 8589950814 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.273980:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580314.274032:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283215:x1863919946690816:12345-192.168.202.9@tcp:36:touch.500 Request processed in 378us (1726us total) trans 8589950814 rc 0/0 00000100:00100000:2.0:1777580314.274039:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19598 00000100:00100000:2.0:1777580314.274044:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835207492951 time 7835222503721 state 0x2 ref 0 00000100:00100000:2.0:1777580314.274074:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835223037563 time 7835222937563 state 0x1 ref 5 00000100:00100000:2.0:1777580314.274084:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283223:x1863919946691072:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.274094:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.274104:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b91b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7e8 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274172:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274182:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274189:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274201:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274207:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274213:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274284:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274294:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274312:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.274335:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81e:0x0]: returning size 0 00000004:00200000:2.0:1777580314.274338:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.274349:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274359:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274366:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274372:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274379:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274385:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.274388:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274394:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274402:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.274405:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.274409:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274426:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4b922 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274439:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274445:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274451:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274456:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.274459:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274464:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274471:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0249f048700) 00010000:00010000:2.0:1777580314.274473:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.274476:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274481:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4b929 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274507:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4b91b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e8 expref: 128 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274531:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e8 expref: 127 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274538:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:2.0:1777580314.274540:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.274542:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9800, rc 0) 00000100:00100000:2.0:1777580314.274565:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283223:x1863919946691072:12345-192.168.202.9@tcp:101:rm.500 Request processed in 482us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.274571:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19600 00000100:00100000:2.0:1777580314.274586:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835223550039 time 7835223450039 state 0x1 ref 4 00000100:00100000:2.0:1777580314.274597:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283226:x1863919946691200:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.274605:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.274612:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b937 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7ef expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274657:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274665:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274673:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274684:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274702:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274709:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274762:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274771:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274778:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.274797:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81f:0x0]: returning size 0 00000004:00200000:2.0:1777580314.274800:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.274824:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274833:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274841:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274846:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274853:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274868:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.274872:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274878:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274886:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.274888:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.274891:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274896:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4b93e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274906:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274912:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274917:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274921:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.274924:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274930:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274948:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa0249f048a00) 00010000:00010000:2.0:1777580314.274951:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.274954:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274959:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4b945 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274985:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4b937 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7ef expref: 128 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.274998:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7ef expref: 127 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275005:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa02498f4ad00) 00010000:00010000:2.0:1777580314.275008:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.275010:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8200, rc 0) 00000100:00100000:2.0:1777580314.275035:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283226:x1863919946691200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 439us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.275041:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19601 00000100:00100000:2.0:1777580314.275061:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224024016 time 7835223924016 state 0x1 ref 3 00000100:00100000:2.0:1777580314.275071:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283237:x1863919946691328:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.275080:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.275090:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b953 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7f6 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275159:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275168:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275174:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275185:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275190:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275196:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275244:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275252:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275259:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.275277:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x822:0x0]: returning size 0 00000004:00200000:2.0:1777580314.275280:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.275289:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275308:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275315:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275321:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275326:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275330:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.275333:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275338:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275346:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.275349:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.275352:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275358:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4b95a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275368:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275374:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275385:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275390:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.275393:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275398:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275406:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0249f048d00) 00010000:00010000:2.0:1777580314.275408:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.275411:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275417:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4b961 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275441:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4b953 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7f6 expref: 128 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275452:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7f6 expref: 127 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275458:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa024ae57b600) 00010000:00010000:2.0:1777580314.275460:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.275463:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1200, rc 0) 00000100:00100000:2.0:1777580314.275486:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283237:x1863919946691328:12345-192.168.202.9@tcp:101:rm.500 Request processed in 417us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.275502:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19602 00000100:00100000:2.0:1777580314.275520:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224483068 time 7835224383068 state 0x1 ref 2 00000100:00100000:2.0:1777580314.275530:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283240:x1863919946691456:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.275540:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.275549:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b96f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e7fd expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275578:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275588:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275595:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275606:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275613:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275619:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275669:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275676:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275690:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.275713:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x823:0x0]: returning size 0 00000004:00200000:2.0:1777580314.275715:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.275724:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275733:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275740:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275746:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275752:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275757:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.275760:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275766:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275774:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.275776:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.275779:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275795:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4b976 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.275806:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.275990:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224483068 time 7835224850872 state 0x0 ref 2 00000100:00100000:3.0:1777580314.276007:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283227:x1863919946691584:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.276017:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.276029:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b98b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e804 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276064:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276073:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276082:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276104:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276111:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276118:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276194:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276203:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276210:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580314.276229:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x820:0x0]: returning size 0 00000004:00200000:3.0:1777580314.276232:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.276242:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276250:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276257:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276263:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276279:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276284:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.276287:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276293:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276302:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.276304:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.276306:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276312:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4b992 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276323:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276328:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276333:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276337:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.276340:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276354:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276361:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa0248e788000) 00010000:00010000:3.0:1777580314.276362:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.276365:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276370:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4b999 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276396:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4b98b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e804 expref: 129 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276409:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e804 expref: 128 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.276416:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa0248e788800) 00010000:00010000:3.0:1777580314.276418:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.276420:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839e00, rc 0) 00000100:00100000:3.0:1777580314.276461:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+128:283227:x1863919946691584:12345-192.168.202.9@tcp:101:rm.500 Request processed in 459us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.276469:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19604 00010000:00010000:2.0:1777580314.287366:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287381:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287389:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.287396:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287407:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287429:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa0249f048b00) 00010000:00010000:2.0:1777580314.287432:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.287438:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287446:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4b97d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287531:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4b96f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7fd expref: 128 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287578:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7fd expref: 127 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.287587:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:2.0:1777580314.287590:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.287593:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6800, rc 0) 00000100:00100000:2.0:1777580314.287696:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.287784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.307331:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.314109:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691712 00000100:00100000:3.0:1777580314.314144:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691712 00000100:00100000:3.0:1777580314.314210:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224950872 time 7835224850872 state 0x1 ref 2 00000100:00100000:3.0:1777580314.314272:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946691968 00000100:00100000:3.0:1777580314.314285:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946691968 00000100:00100000:3.0:1777580314.314316:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835207492951 time 7835222503721 state 0x0 ref 1 00000100:00100000:3.0:1777580314.314325:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835222603721 time 7835222503721 state 0x1 ref 1 00000100:00100000:3.0:1777580314.314348:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835222603721 time 7835263210189 state 0x0 ref 1 00000100:00100000:3.0:1777580314.314366:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+385:283244:x1863919946691968:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.314399:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.314425:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b9a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e812 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314618:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314639:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314654:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314673:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314680:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.314687:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.315295:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e0:0x0], index 0: 0 00010000:00010000:3.0:1777580314.315492:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b9bc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315504:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315513:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315553:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315561:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315568:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315574:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.315579:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315586:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315599:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.315602:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.315607:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315613:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4b9ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.315636:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008ab4a77f reply state 000000007c70bf4f transno 8589950815 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.315646:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.315680:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4b9a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e812 expref: 388 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315694:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b9bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e812 expref: 387 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315702:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.315705:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.315707:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00000100:00100000:3.0:1777580314.315800:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283244:x1863919946691968:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1440us (28015us total) trans 8589950815 rc 0/0 00000100:00100000:3.0:1777580314.315809:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19606 00000100:00100000:3.0:1777580314.315830:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835222603721 time 7835263210189 state 0x2 ref 0 00000100:00100000:3.0:1777580314.315868:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224950872 time 7835264731400 state 0x0 ref 2 00000100:00100000:3.0:1777580314.315881:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+128:283233:x1863919946691712:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.315897:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.315907:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b9ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e80b expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315957:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315972:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315979:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315992:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.315999:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316005:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316070:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316077:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316083:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580314.316105:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x821:0x0]: returning size 0 00000004:00200000:3.0:1777580314.316110:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.316121:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316131:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316173:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316179:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316185:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316190:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.316193:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316198:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316206:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.316208:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.316210:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316216:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4b9d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316225:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316231:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316237:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316247:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.316250:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316255:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316262:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02493ac1a00) 00010000:00010000:3.0:1777580314.316264:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.316266:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316271:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4b9d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316295:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4b9ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e80b expref: 130 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316305:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e80b expref: 129 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.316311:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:3.0:1777580314.316313:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.316315:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:3.0:1777580314.316340:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283233:x1863919946691712:12345-192.168.202.9@tcp:101:rm.500 Request processed in 462us (28646us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.316346:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19605 00000100:00080000:3.0:1777580314.316377:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580314.316993:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317018:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317042:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317057:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317091:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.317127:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692480 00000100:00100000:2.0:1777580314.317155:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692480 00000100:00100000:2.0:1777580314.317195:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692224 00000100:00100000:2.0:1777580314.317197:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692224 00000100:00100000:2.0:1777580314.317212:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692608 00000100:00100000:2.0:1777580314.317214:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692608 00000100:00100000:2.0:1777580314.317226:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692736 00000100:00100000:2.0:1777580314.317228:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692736 00000100:00100000:2.0:1777580314.317239:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692864 00000100:00100000:2.0:1777580314.317336:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692864 00000100:00100000:2.0:1777580314.317363:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11970 00000100:00100000:2.0:1777580314.317372:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2363:x1863919946692480:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.317403:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.317426:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e82e expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.317455:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15dc:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.317474:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317476:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317485:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317501:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317515:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7200, rc 0) 00000100:00100000:2.0:1777580314.317553:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946692480:12345-192.168.202.9@tcp:101:rm.500 Request processed in 182us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.317560:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11970 00000100:00100000:2.0:1777580314.317577:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11971 00000100:00100000:2.0:1777580314.317582:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2363:x1863919946692224:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.317589:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.317599:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e820 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.317617:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b6:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.317624:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317631:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317635:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317647:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317656:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7e00, rc 0) 00000100:00100000:2.0:1777580314.317672:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946692224:12345-192.168.202.9@tcp:101:rm.500 Request processed in 90us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.317678:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11971 00000100:00100000:2.0:1777580314.317690:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11972 00000100:00100000:2.0:1777580314.317695:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946692608:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.317701:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.317709:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e835 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.317720:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15dd:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.317731:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317733:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317736:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317747:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317766:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7c00, rc 0) 00000100:00100000:2.0:1777580314.317783:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946692608:12345-192.168.202.9@tcp:101:rm.500 Request processed in 88us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.317789:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11972 00000100:00100000:2.0:1777580314.317799:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11973 00000100:00100000:2.0:1777580314.317805:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946692736:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.317821:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.317835:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e83c expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.317848:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b7:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.317857:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317858:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317863:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317872:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317881:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248c032400, rc 0) 00000100:00100000:2.0:1777580314.317899:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2362:x1863919946692736:12345-192.168.202.9@tcp:101:rm.500 Request processed in 94us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.317905:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11973 00000100:00100000:2.0:1777580314.317918:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11974 00000100:00100000:2.0:1777580314.317930:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946692864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.317936:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.317948:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e843 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.317962:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15db:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.317971:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317972:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.317976:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317985:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 36 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.317993:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f400, rc 0) 00000100:00100000:2.0:1777580314.318012:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2362:x1863919946692864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 83us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.318017:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11974 00000100:00100000:2.0:1777580314.318074:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692096 00000100:00100000:2.0:1777580314.318080:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692096 00000100:00100000:2.0:1777580314.318104:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835222603721 time 7835263210189 state 0x0 ref 1 00000100:00100000:2.0:1777580314.318115:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835263310189 time 7835263210189 state 0x1 ref 1 00000100:00100000:2.0:1777580314.318161:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692352 00000100:00100000:2.0:1777580314.318165:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692352 00000100:00100000:2.0:1777580314.318178:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835263310189 time 7835263210189 state 0x1 ref 2 00000100:00100000:2.0:1777580314.318208:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835267171006 time 7835267071006 state 0x1 ref 2 00000100:00100000:2.0:1777580314.318218:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283211:x1863919946692096:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580314.318234:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1777580314.326689:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835267171006 time 7835275540415 state 0x0 ref 2 00000100:00100000:3.0:1777580314.326730:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283215:x1863919946692352:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.326768:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.326795:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4ba09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e827 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.326887:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4ba10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e819 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.326967:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4ba10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x826:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e819 expref: 132 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.326985:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4ba10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x826:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e819 expref: 132 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327009:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa02499549300) 00010000:00010000:2.0:1777580314.327012:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580314.327017:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680fe00, rc 0) 00000100:00100000:2.0:1777580314.327093:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+132:283211:x1863919946692096:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8875us (19778us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.327102:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19607 00010000:00010000:2.0:1777580314.327176:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327185:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327194:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327211:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.327217:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327224:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327237:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:2.0:1777580314.327239:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.327373:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.327382:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4b914 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.327639:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283240:x1863919946691456:12345-192.168.202.9@tcp:101:rm.500 Request processed in 52108us (55171us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.327647:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19603 00000100:00100000:2.0:1777580314.327653:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224950872 time 7835264731400 state 0x2 ref 0 00010000:00010000:3.0:1777580314.332749:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x827:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e827 expref: 129 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.332779:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4ba09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x827:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e827 expref: 129 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.332807:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:3.0:1777580314.332820:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.332825:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:3.0:1777580314.332918:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283215:x1863919946692352:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6205us (15926us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.332930:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19608 00000100:00100000:3.0:1777580314.332941:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835267171006 time 7835275540415 state 0x2 ref 0 00000100:00100000:2.0:1777580314.333297:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.333326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.333496:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333507:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333515:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333540:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.333546:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333555:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333569:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248e788b00) 00010000:00010000:3.0:1777580314.333573:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.333577:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333584:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4b9b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.333626:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946692992 00000100:00100000:3.0:1777580314.333637:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946692992 00000100:00100000:3.0:1777580314.333691:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11975 00000100:00100000:3.0:1777580314.333701:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2364:x1863919946692992:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.333719:0:206018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.333742:0:206018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e84a expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580314.333771:0:206018:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b8:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:3.0:1777580314.333792:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.333795:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.333804:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 37 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333848:0:206018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 37 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.333861:0:206018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:3.0:1777580314.333913:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2364:x1863919946692992:12345-192.168.202.9@tcp:101:rm.500 Request processed in 214us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.333921:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11975 00000100:00100000:3.0:1777580314.333952:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946693248 00000100:00100000:3.0:1777580314.333956:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946693248 00000100:00100000:3.0:1777580314.333979:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835267171006 time 7835275540415 state 0x0 ref 1 00000100:00100000:3.0:1777580314.333990:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835275640415 time 7835275540415 state 0x1 ref 1 00000100:00100000:3.0:1777580314.334015:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835275640415 time 7835282876693 state 0x0 ref 1 00000100:00100000:3.0:1777580314.334025:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283244:x1863919946693248:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.334082:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580314.334102:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4b9bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e812 expref: 387 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.334113:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.334120:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.334232:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.335443:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.335475:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.335675:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000068b58338 reply state 000000009ae39805 transno 8589950816 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.335685:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.335823:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283244:x1863919946693248:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1784us (2511us total) trans 8589950816 rc 0/0 00000100:00100000:3.0:1777580314.335834:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19609 00000100:00100000:3.0:1777580314.335843:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835275640415 time 7835282876693 state 0x2 ref 0 00000100:00100000:3.0:1777580314.353555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.353621:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.353680:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.353706:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.353798:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.353845:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946693376 00000100:00100000:3.0:1777580314.353857:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946693376 00000100:00100000:3.0:1777580314.353911:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946693504 00000100:00100000:3.0:1777580314.353914:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946693504 00000100:00100000:3.0:1777580314.353931:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946693888 00000100:00100000:3.0:1777580314.353934:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946693888 00000100:00100000:3.0:1777580314.353953:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11976 00000100:00100000:3.0:1777580314.353963:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946693376:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.354469:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2361:x1863919946693376:12345-192.168.202.9@tcp:2:touch.500 Request processed in 505us (927us total) trans 8589939022 rc 0/0 00000100:00100000:3.0:1777580314.354478:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11976 00000100:00100000:3.0:1777580314.354529:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11977 00000100:00100000:3.0:1777580314.354538:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2363:x1863919946693504:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580314.354654:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11978 00000100:00100000:1.0:1777580314.354664:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2363:x1863919946693888:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580314.354676:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.354702:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e858 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.354716:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946693504:12345-192.168.202.9@tcp:2:touch.500 Request processed in 180us (1094us total) trans 8589938621 rc 0/0 00000100:00100000:3.0:1777580314.354722:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11977 00002000:00010000:1.0:1777580314.354731:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15b9:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:3.0:1777580314.354751:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.354752:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580314.354755:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.354760:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.354765:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 39 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.354768:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.354775:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.354781:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.354789:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.354798:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 39 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.354805:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa02493ac1900) 00010000:00010000:3.0:1777580314.354808:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.354825:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.354831:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba1e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.354832:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4a00, rc 0) 00000100:00100000:1.0:1777580314.354856:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946693888:12345-192.168.202.9@tcp:101:rm.500 Request processed in 195us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.354862:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11978 00000100:00100000:3.0:1777580314.354865:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946693760 00000100:00100000:3.0:1777580314.354879:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946693760 00000100:00100000:3.0:1777580314.354906:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835275640415 time 7835282876693 state 0x0 ref 1 00000100:00100000:3.0:1777580314.354918:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835282976693 time 7835282876693 state 0x1 ref 1 00000100:00100000:3.0:1777580314.354936:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946694016 00000100:00100000:3.0:1777580314.354940:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946694016 00000100:00100000:3.0:1777580314.354951:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835282976693 time 7835282876693 state 0x1 ref 2 00000100:00100000:3.0:1777580314.354968:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835303930944 time 7835303830944 state 0x1 ref 2 00000100:00100000:3.0:1777580314.354978:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283218:x1863919946693760:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.354990:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.355001:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4ba2c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e851 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355166:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355182:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355192:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355207:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355214:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.355221:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.355765:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15bc:0x0], index 1: 0 00000100:00100000:0.0:1777580314.356997:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835303930944 time 7835305852087 state 0x0 ref 2 00000100:00100000:0.0:1777580314.357036:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+387:283244:x1863919946694016:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.357067:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.357096:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4ba41 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e85f expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.357216:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4ba41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e85f expref: 388 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.357232:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4ba41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e85f expref: 388 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.357254:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:0.0:1777580314.357258:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580314.357263:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86200, rc 0) 00000100:00100000:0.0:1777580314.357341:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283244:x1863919946694016:12345-192.168.202.9@tcp:101:touch.500 Request processed in 324us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.357366:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19611 00010000:00010000:3.0:1777580314.373002:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ba48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373033:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ba48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373050:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ba48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373104:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373113:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373120:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373127:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.373156:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373165:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373179:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.373183:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.373188:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373213:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4ba33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.373229:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c547dca7 reply state 000000003eef2060 transno 8589950817 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.373240:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.373291:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4ba2c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e851 expref: 132 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373310:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ba48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e851 expref: 131 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.373318:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.373320:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.373323:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680ee00, rc 0) 00000100:00100000:3.0:1777580314.373428:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+132:283218:x1863919946693760:12345-192.168.202.9@tcp:101:touch.500 Request processed in 18450us (19745us total) trans 8589950817 rc 0/0 00000100:00100000:3.0:1777580314.373438:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19610 00000100:00100000:3.0:1777580314.373447:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835303930944 time 7835305852087 state 0x2 ref 0 00000100:00100000:0.0:1777580314.373793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.373954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.373990:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.374198:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946694272 00000100:00100000:3.0:1777580314.374209:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946694272 00000100:00100000:1.0:1777580314.374237:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946694656 00000100:00100000:1.0:1777580314.374241:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946694656 00000100:00100000:1.0:1777580314.374273:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4201 00000100:00100000:1.0:1777580314.374295:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+133:283211:x1863919946694656:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.376100:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+134:283211:x1863919946694656:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1804us (2094us total) trans 8589950818 rc 0/0 00000100:00100000:3.0:1777580314.383039:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4202 00000100:00100000:3.0:1777580314.383077:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+134:283215:x1863919946694272:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.383743:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+135:283215:x1863919946694272:12345-192.168.202.9@tcp:35:touch.500 Request processed in 683us (9947us total) trans 8589950819 rc 0/0 00000100:00100000:3.0:1777580314.383781:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4202 00000100:00100000:3.0:1777580314.383923:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946694400 00000100:00100000:3.0:1777580314.383933:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946694400 00000100:00100000:3.0:1777580314.383983:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11979 00000100:00100000:3.0:1777580314.383993:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2363:x1863919946694400:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580314.384172:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4201 00000100:00100000:3.0:1777580314.384297:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2363:x1863919946694400:12345-192.168.202.9@tcp:2:touch.500 Request processed in 305us (10342us total) trans 8589939023 rc 0/0 00000100:00100000:3.0:1777580314.384304:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11979 00000100:00100000:0.0:1777580314.388741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.388870:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.398406:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398426:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398435:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398441:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.398448:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398458:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398479:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580314.398483:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.398489:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.398513:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4ba3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.399846:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946694912 00000100:00100000:3.0:1777580314.399864:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946694912 00000100:00100000:3.0:1777580314.400016:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835303930944 time 7835305852087 state 0x0 ref 1 00000100:00100000:3.0:1777580314.400036:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835305952087 time 7835305852087 state 0x1 ref 1 00000100:00100000:3.0:1777580314.400062:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946695168 00000100:00100000:3.0:1777580314.400066:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946695168 00000100:00100000:3.0:1777580314.400081:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835305952087 time 7835305852087 state 0x1 ref 2 00000100:00100000:3.0:1777580314.400102:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349064208 time 7835348964208 state 0x1 ref 2 00000100:00100000:3.0:1777580314.400120:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+134:283218:x1863919946694912:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.400221:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580314.400254:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ba48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e851 expref: 134 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400271:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.400282:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.400376:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400392:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400403:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.400594:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000102f6550 reply state 00000000ebfb3f0e transno 8589950820 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.400604:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.400733:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+135:283218:x1863919946694912:12345-192.168.202.9@tcp:36:touch.500 Request processed in 619us (12006us total) trans 8589950820 rc 0/0 00000100:00100000:3.0:1777580314.400742:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19612 00000100:00100000:3.0:1777580314.400770:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349064208 time 7835349632600 state 0x0 ref 1 00000100:00100000:3.0:1777580314.400780:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+134:283219:x1863919946695168:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.400793:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.400806:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e866 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400951:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400963:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400971:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400987:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.400993:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.401014:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.401588:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e1:0x0], index 0: 0 00010000:00010000:1.0:1777580314.420342:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4ba72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420373:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420399:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4ba72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420449:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420456:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420464:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420488:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.420493:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420501:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420516:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.420520:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.420526:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420532:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4ba64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.420550:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000055690ea2 reply state 00000000910b458c transno 8589950821 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.420561:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.420613:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ba5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e866 expref: 137 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420631:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4ba72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e866 expref: 136 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.420641:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa02483f8e000) 00010000:00010000:1.0:1777580314.420643:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.420646:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5400, rc 0) 00000100:00100000:1.0:1777580314.420758:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283219:x1863919946695168:12345-192.168.202.9@tcp:101:touch.500 Request processed in 19977us (31886us total) trans 8589950821 rc 0/0 00000100:00100000:1.0:1777580314.420777:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19613 00000100:00100000:1.0:1777580314.420803:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349064208 time 7835349632600 state 0x2 ref 0 00000100:00100000:1.0:1777580314.420918:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.421095:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580314.421125:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421227:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421235:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421240:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.421244:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421250:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421261:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa0248e788000) 00010000:00010000:1.0:1777580314.421264:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.421267:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421272:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4ba56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.421319:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946695552 00000100:00100000:1.0:1777580314.421339:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946695552 00000100:00100000:1.0:1777580314.421372:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349064208 time 7835349632600 state 0x0 ref 1 00000100:00100000:1.0:1777580314.421384:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349732600 time 7835349632600 state 0x1 ref 1 00000100:00100000:1.0:1777580314.421416:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349732600 time 7835370277390 state 0x0 ref 1 00000100:00100000:1.0:1777580314.421430:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283218:x1863919946695552:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.421460:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.421479:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4ba80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e86d expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421535:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4ba80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x828:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e86d expref: 137 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421547:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4ba80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x828:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e86d expref: 137 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.421565:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:1.0:1777580314.421568:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580314.421570:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5a00, rc 0) 00000100:00100000:1.0:1777580314.421610:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283218:x1863919946695552:12345-192.168.202.9@tcp:101:touch.500 Request processed in 183us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.421617:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19614 00000100:00100000:1.0:1777580314.421622:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349732600 time 7835370277390 state 0x2 ref 0 00000100:00100000:3.0:1777580314.423615:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946695424 00000100:00100000:3.0:1777580314.423635:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946695424 00000100:00100000:3.0:1777580314.423710:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4203 00000100:00100000:3.0:1777580314.423723:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:283244:x1863919946695424:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.424196:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283244:x1863919946695424:12345-192.168.202.9@tcp:35:touch.500 Request processed in 475us (3278us total) trans 8589950822 rc 0/0 00000100:00100000:3.0:1777580314.424205:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4203 00000100:00100000:0.0:1777580314.432610:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.432652:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946695808 00000100:00100000:0.0:1777580314.432664:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946695808 00000100:00100000:0.0:1777580314.432714:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835349732600 time 7835370277390 state 0x0 ref 1 00000100:00100000:0.0:1777580314.432731:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835370377390 time 7835370277390 state 0x1 ref 1 00000100:00100000:0.0:1777580314.432758:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835370377390 time 7835381619614 state 0x0 ref 1 00000100:00100000:0.0:1777580314.432772:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283219:x1863919946695808:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580314.432880:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580314.432915:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4ba72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e866 expref: 137 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.432935:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa02483f8e000) 00010000:00010000:0.0:1777580314.432950:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.433039:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.433055:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.433090:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.433296:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000288bfdf5 reply state 000000000054efa5 transno 8589950823 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.433306:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580314.433419:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283219:x1863919946695808:12345-192.168.202.9@tcp:36:touch.500 Request processed in 648us (822us total) trans 8589950823 rc 0/0 00000100:00100000:0.0:1777580314.433428:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19615 00000100:00100000:0.0:1777580314.433434:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835370377390 time 7835381619614 state 0x2 ref 0 00010000:00010000:3.0:1777580314.435854:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435877:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435886:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435893:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.435898:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435907:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435926:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02493ac1900) 00010000:00010000:3.0:1777580314.435948:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.435954:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.435960:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5800/0xcb2b2f2f7e4ba6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.436194:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.436375:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436384:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436433:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436439:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.436442:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436448:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436458:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:3.0:1777580314.436460:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.436463:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.436468:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4ba87 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.436668:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946695936 00000100:00100000:1.0:1777580314.436681:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946695936 00000100:00100000:1.0:1777580314.436736:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835224950872 time 7835264731400 state 0x0 ref 1 00000100:00100000:1.0:1777580314.436750:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835264831400 time 7835264731400 state 0x1 ref 1 00000100:00100000:1.0:1777580314.436796:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835264831400 time 7835385658546 state 0x0 ref 1 00000100:00100000:1.0:1777580314.436820:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283265:x1863919946695936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580314.436848:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.436868:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4ba8e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e874 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.436954:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.436972:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.436986:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437006:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437012:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437018:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437198:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437222:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437230:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580314.437264:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x826:0x0]: returning size 0 00000004:00200000:1.0:1777580314.437269:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580314.437292:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437306:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437315:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437322:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437328:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437333:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.437335:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437342:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437353:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.437362:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.437367:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437374:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4ba95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437399:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437405:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437411:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437416:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.437419:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437425:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437433:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024989ec600) 00010000:00010000:1.0:1777580314.437435:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.437438:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437443:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4ba9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437478:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4ba8e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e874 expref: 138 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437501:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e874 expref: 137 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.437509:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa02499549300) 00010000:00010000:1.0:1777580314.437511:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.437514:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4c00, rc 0) 00000100:00100000:1.0:1777580314.437594:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283265:x1863919946695936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 787us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.437604:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19616 00000100:00100000:1.0:1777580314.437609:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835264831400 time 7835385658546 state 0x2 ref 0 00000100:00100000:0.0:1777580314.450515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.450602:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696064 00000100:00100000:3.0:1777580314.450616:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696064 00000100:00100000:3.0:1777580314.457010:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11980 00000100:00100000:3.0:1777580314.457036:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2361:x1863919946696064:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.457538:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2361:x1863919946696064:12345-192.168.202.9@tcp:2:touch.500 Request processed in 511us (7034us total) trans 8589938622 rc 0/0 00000100:00100000:3.0:1777580314.457547:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11980 00000100:00100000:1.0:1777580314.459112:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.461186:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696192 00000100:00100000:3.0:1777580314.461206:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696192 00000100:00100000:3.0:1777580314.461264:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835370377390 time 7835381619614 state 0x0 ref 1 00000100:00100000:3.0:1777580314.461281:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835381719614 time 7835381619614 state 0x1 ref 1 00000100:00100000:3.0:1777580314.461314:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835381719614 time 7835410175261 state 0x0 ref 1 00000100:00100000:3.0:1777580314.461334:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283219:x1863919946696192:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.461365:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.461396:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4baaa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e87b expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.461477:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4baaa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x829:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e87b expref: 138 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.461494:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4baaa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x829:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e87b expref: 138 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.461519:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580314.461523:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.461527:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4800, rc 0) 00000100:00100000:3.0:1777580314.461633:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283219:x1863919946696192:12345-192.168.202.9@tcp:101:touch.500 Request processed in 307us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.461642:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19617 00000100:00100000:3.0:1777580314.461647:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835381719614 time 7835410175261 state 0x2 ref 0 00000100:00100000:1.0:1777580314.471300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.471350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.471378:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.471421:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.471459:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696960 00000100:00100000:1.0:1777580314.471471:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696960 00000100:00100000:1.0:1777580314.471534:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4204 00000100:00100000:1.0:1777580314.471545:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283218:x1863919946696960:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.472012:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283218:x1863919946696960:12345-192.168.202.9@tcp:35:touch.500 Request processed in 467us (587us total) trans 8589950824 rc 0/0 00000100:00100000:1.0:1777580314.472022:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4204 00000100:00100000:0.0:1777580314.474941:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696448 00000100:00100000:0.0:1777580314.474962:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696448 00000100:00100000:0.0:1777580314.475057:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11981 00000100:00100000:0.0:1777580314.475071:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2362:x1863919946696448:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.475095:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.475127:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e882 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580314.475184:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15df:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580314.475212:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.475214:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.475228:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 38 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475277:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 38 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475295:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86600, rc 0) 00000100:00100000:0.0:1777580314.475372:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2362:x1863919946696448:12345-192.168.202.9@tcp:101:rm.500 Request processed in 305us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.475381:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11981 00000100:00100000:0.0:1777580314.475420:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696576 00000100:00100000:0.0:1777580314.475425:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696576 00000100:00100000:0.0:1777580314.475453:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835264831400 time 7835385658546 state 0x0 ref 1 00000100:00100000:0.0:1777580314.475466:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835385758546 time 7835385658546 state 0x1 ref 1 00000100:00100000:0.0:1777580314.475494:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946696704 00000100:00100000:0.0:1777580314.475498:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946696704 00000100:00100000:0.0:1777580314.475513:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835385758546 time 7835385658546 state 0x1 ref 2 00000100:00100000:0.0:1777580314.475530:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835424493469 time 7835424393469 state 0x1 ref 2 00000100:00100000:0.0:1777580314.475540:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283196:x1863919946696576:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580314.475598:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580314.475629:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4b762 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e763 expref: 139 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475654:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4b635 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e70f expref: 138 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475684:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa02484c59800) 00010000:00010000:0.0:1777580314.475697:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.475722:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475737:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475749:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475765:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475772:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475778:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475951:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475960:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.475967:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580314.476604:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1875, 64 off128192 00000004:00080000:0.0:1777580314.476620:0:187632:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7835425483583ns, next at 7836425479438ns, rc = 0 00010000:00010000:0.0:1777580314.476710:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476722:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476730:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476738:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476743:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476749:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476770:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580314.476797:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.476801:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835424493469 time 7835425660855 state 0x0 ref 2 00010000:00010000:0.0:1777580314.476803:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476823:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476830:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.476834:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476842:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.476844:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283266:x1863919946696704:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.476858:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:0.0:1777580314.476861:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580314.476864:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476865:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.476871:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bac6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476877:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bad4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e889 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476892:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476897:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476903:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476908:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.476910:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476916:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476922:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.476925:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.476927:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476928:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.476934:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bab8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476936:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476944:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.476957:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c0d60371 reply state 00000000643b8e0f transno 8589950825 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476960:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.476967:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.476967:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.476973:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477040:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.477047:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283196:x1863919946696576:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1507us (5772us total) trans 8589950825 rc 0/0 00010000:00010000:1.0:1777580314.477048:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477056:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.477056:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19618 00000004:00200000:1.0:1777580314.477097:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7f9:0x0]: returning size 0 00000004:00200000:1.0:1777580314.477102:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580314.477117:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477128:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477163:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477169:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477175:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477180:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.477182:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477189:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477196:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.477198:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.477201:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477206:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4badb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477225:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477231:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477236:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477241:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.477244:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477249:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477255:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024989ec400) 00010000:00010000:1.0:1777580314.477258:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.477260:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477266:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bae2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477268:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580314.477274:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477280:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.477283:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477290:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477299:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81b:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:0.0:1777580314.477301:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580314.477304:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477309:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bad4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e889 expref: 391 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477309:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bacd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.477323:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e889 expref: 390 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.477323:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.477324:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.477326:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580314.477342:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:1.0:1777580314.477344:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.477347:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fe00, rc 0) 00000100:00100000:1.0:1777580314.477399:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283266:x1863919946696704:12345-192.168.202.9@tcp:101:rm.500 Request processed in 556us (6013us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580314.477406:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19619 00000100:00100000:1.0:1777580314.477411:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835424493469 time 7835425660855 state 0x2 ref 0 00000100:00100000:0.0:1777580314.477825:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.477985:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946697088 00000100:00100000:3.0:1777580314.477995:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946697088 00000100:00100000:3.0:1777580314.478051:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11982 00000100:00100000:3.0:1777580314.478061:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2361:x1863919946697088:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.478434:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2361:x1863919946697088:12345-192.168.202.9@tcp:2:touch.500 Request processed in 373us (608us total) trans 8589939024 rc 0/0 00000100:00100000:3.0:1777580314.478442:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11982 00000100:00100000:0.0:1777580314.508025:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.508096:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508112:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508121:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508127:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.508149:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508158:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508180:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa0248a60ef00) 00010000:00010000:3.0:1777580314.508191:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.508198:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508205:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4babf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.508378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.508447:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946697472 00000100:00100000:3.0:1777580314.508460:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946697472 00000100:00100000:3.0:1777580314.508576:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11983 00000100:00100000:3.0:1777580314.508587:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2364:x1863919946697472:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.508611:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.508635:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e890 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580314.508665:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e0:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:3.0:1777580314.508689:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.508691:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.508702:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 30 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508722:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 30 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.508736:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5800, rc 0) 00000100:00100000:1.0:1777580314.520088:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946697344 00000100:00100000:1.0:1777580314.520108:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946697344 00000100:00100000:1.0:1777580314.520187:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835424493469 time 7835425660855 state 0x0 ref 1 00000100:00100000:1.0:1777580314.520203:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835425760855 time 7835425660855 state 0x1 ref 1 00000100:00100000:1.0:1777580314.520235:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835425760855 time 7835469098063 state 0x0 ref 1 00000100:00100000:1.0:1777580314.520253:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283209:x1863919946697344:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580314.520343:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580314.520377:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4b7a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e771 expref: 138 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520418:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4b658 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e71d expref: 137 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520434:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa0249f048900) 00010000:00010000:1.0:1777580314.520445:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.520495:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520513:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520525:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520541:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520548:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520554:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520700:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520707:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.520714:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.524097:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2364:x1863919946697472:12345-192.168.202.9@tcp:101:rm.500 Request processed in 15495us (15703us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.524113:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11983 00000040:00080000:1.0:1777580314.524355:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1881, 64 off128576 00010000:00010000:1.0:1777580314.527047:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527078:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527120:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527130:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527158:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527164:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527198:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580314.527229:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527235:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527240:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527246:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.527251:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527258:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527271:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa024989ec600) 00010000:00010000:1.0:1777580314.527274:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580314.527287:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527293:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bb05 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527319:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527325:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527330:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527335:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.527337:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527343:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527351:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.527354:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.527357:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.527363:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4baf7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.527374:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e194dba reply state 00000000df75cd63 transno 8589950826 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.529585:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.529732:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283209:x1863919946697344:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9479us (21716us total) trans 8589950826 rc 0/0 00000100:00100000:1.0:1777580314.529744:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19620 00000100:00100000:1.0:1777580314.529754:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835425760855 time 7835469098063 state 0x2 ref 0 00010000:00010000:3.0:1777580314.530961:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580314.530976:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.530988:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580314.530993:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.531004:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.531027:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81c:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580314.531031:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580314.531036:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.531043:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bb0c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.531071:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.531073:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.531075:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580314.531110:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.542828:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946697728 00000100:00100000:3.0:1777580314.542849:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946697728 00000100:00100000:3.0:1777580314.542923:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4205 00000100:00100000:3.0:1777580314.542935:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283219:x1863919946697728:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.544621:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283219:x1863919946697728:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1676us (13502us total) trans 8589950827 rc 0/0 00000100:00100000:3.0:1777580314.544637:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4205 00000100:00100000:2.0:1777580314.547008:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.549665:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946697984 00000100:00100000:3.0:1777580314.549707:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946697984 00000100:00100000:3.0:1777580314.549768:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835425760855 time 7835469098063 state 0x0 ref 1 00000100:00100000:3.0:1777580314.549787:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835469198063 time 7835469098063 state 0x1 ref 1 00000100:00100000:3.0:1777580314.549844:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835469198063 time 7835498704973 state 0x0 ref 1 00000100:00100000:3.0:1777580314.549866:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283266:x1863919946697984:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580314.549971:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580314.550009:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bae9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e889 expref: 390 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550040:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4ba41 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e85f expref: 389 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550057:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:3.0:1777580314.550070:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.550105:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550124:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550156:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550175:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550182:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550196:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550366:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550376:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.550384:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580314.551054:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1882, 64 off128640 00010000:00010000:3.0:1777580314.551164:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551177:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551187:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551196:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551203:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551211:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551241:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580314.551277:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551284:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551291:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551297:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.551302:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551310:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551322:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:3.0:1777580314.551325:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580314.551330:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551337:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb21 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551361:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551368:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551374:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551390:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.551393:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551400:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551409:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.551411:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.551415:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551421:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.551434:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007b86f5df reply state 0000000074ab5601 transno 8589950828 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.551444:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.551564:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283266:x1863919946697984:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1704us (4565us total) trans 8589950828 rc 0/0 00000100:00100000:3.0:1777580314.551574:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19621 00000100:00100000:3.0:1777580314.551583:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835469198063 time 7835498704973 state 0x2 ref 0 00010000:00010000:3.0:1777580314.551639:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551648:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551667:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551673:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.551676:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551683:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551692:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024989ec400) 00010000:00010000:3.0:1777580314.551695:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.551698:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551704:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bafe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551739:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580314.551745:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551752:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580314.551755:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551761:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551770:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7f9:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:3.0:1777580314.551779:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580314.551783:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551788:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb28 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7f9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.551803:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.551805:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.551807:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580314.572517:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.572703:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946698240 00000100:00100000:0.0:1777580314.572716:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946698240 00000100:00100000:0.0:1777580314.572769:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835469198063 time 7835498704973 state 0x0 ref 1 00000100:00100000:0.0:1777580314.572792:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835498804973 time 7835498704973 state 0x1 ref 1 00000100:00100000:0.0:1777580314.572839:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835498804973 time 7835521701125 state 0x0 ref 1 00000100:00100000:0.0:1777580314.572854:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283189:x1863919946698240:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580314.572942:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580314.572980:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4b785 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e76a expref: 138 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573004:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4b5d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x819:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6f3 expref: 137 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573016:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa024ae57b500) 00010000:00010000:0.0:1777580314.573029:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.573060:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573080:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573092:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573107:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573130:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573169:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573319:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573328:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.573336:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580314.573942:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1876, 64 off128256 00010000:00010000:0.0:1777580314.574025:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574038:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574048:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574057:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574063:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574070:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574106:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580314.574160:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574168:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574175:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574182:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.574187:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574195:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574207:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580314.574210:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580314.574214:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574222:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be400/0xcb2b2f2f7e4bb3d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574244:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574251:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574268:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574274:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.574277:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574284:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574292:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.574295:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.574298:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574304:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bb2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.574315:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007479dd1 reply state 00000000aaa2e265 transno 8589950829 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.574325:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580314.574439:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283189:x1863919946698240:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1584us (1934us total) trans 8589950829 rc 0/0 00000100:00100000:0.0:1777580314.574451:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19622 00000100:00100000:0.0:1777580314.574459:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835498804973 time 7835521701125 state 0x2 ref 0 00010000:00010000:0.0:1777580314.574510:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580314.574517:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574535:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.574538:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574545:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574554:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x819:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580314.574556:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580314.574559:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574565:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bb44 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.574580:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.574582:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.574584:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.583023:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583048:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583058:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583064:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.583070:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583079:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583101:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.583104:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.583109:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.583116:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb1a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.597557:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.597641:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597656:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597665:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597671:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.597677:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597685:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597706:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa0248a60e700) 00010000:00010000:3.0:1777580314.597710:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.597715:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.597722:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bb36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.612123:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946698496 00000100:00100000:2.0:1777580314.612159:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946698496 00000100:00100000:2.0:1777580314.612218:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835381719614 time 7835410175261 state 0x0 ref 1 00000100:00100000:2.0:1777580314.612234:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835410275261 time 7835410175261 state 0x1 ref 1 00000100:00100000:2.0:1777580314.612284:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835410275261 time 7835561146011 state 0x0 ref 1 00000100:00100000:2.0:1777580314.612303:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283275:x1863919946698496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580314.612338:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.612368:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4bb4b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e897 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612548:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612567:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612580:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612598:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612606:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.612612:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580314.613225:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15bd:0x0], index 1: 0 00010000:00010000:2.0:1777580314.613427:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bb60 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613440:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bb60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613462:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bb60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613508:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613515:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613522:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613527:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.613531:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613539:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613553:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.613556:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.613561:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613567:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bb52 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.613582:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c93b3642 reply state 0000000070225419 transno 8589950830 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.613590:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580314.613638:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4bb4b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e897 expref: 392 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613653:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bb60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e897 expref: 391 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.613660:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580314.613662:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.613665:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:2.0:1777580314.613769:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283275:x1863919946698496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1473us (16225us total) trans 8589950830 rc 0/0 00000100:00100000:2.0:1777580314.613780:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19623 00000100:00100000:2.0:1777580314.613788:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835410275261 time 7835561146011 state 0x2 ref 0 00000100:00100000:2.0:1777580314.634160:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.634336:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634353:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634384:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634408:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.634414:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634422:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634488:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02488b77500) 00010000:00010000:3.0:1777580314.634491:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.634498:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.634505:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bb59 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.641854:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.642568:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946698752 00000100:00100000:1.0:1777580314.642584:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946698752 00000100:00100000:1.0:1777580314.642638:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835410275261 time 7835561146011 state 0x0 ref 1 00000100:00100000:1.0:1777580314.642655:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835561246011 time 7835561146011 state 0x1 ref 1 00000100:00100000:1.0:1777580314.642729:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946699008 00000100:00100000:1.0:1777580314.642734:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946699008 00000100:00100000:1.0:1777580314.642754:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835561246011 time 7835561146011 state 0x1 ref 2 00000100:00100000:3.0:1777580314.649730:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835598680035 time 7835598580035 state 0x1 ref 2 00000100:00100000:3.0:1777580314.649773:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283224:x1863919946698752:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.649823:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.649851:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb6e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e89e expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650050:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650081:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650096:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650114:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650121:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.650127:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.655020:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e2:0x0], index 0: 0 00010000:00010000:3.0:1777580314.655304:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bb83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.655327:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bb83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.655341:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bb83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.657698:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835598680035 time 7835606547573 state 0x0 ref 2 00000100:00100000:1.0:1777580314.657745:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283275:x1863919946699008:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.657839:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.657875:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bb60 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e897 expref: 391 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.657901:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa02488b77800) 00010000:00010000:1.0:1777580314.657914:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.658012:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.658047:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.658059:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.658258:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000045eb72fe reply state 0000000036b0e47d transno 8589950832 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.658268:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.658773:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658785:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658792:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658825:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.658830:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658838:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658851:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.658854:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.658859:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658866:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bb75 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.658887:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000687f9769 reply state 000000000fc61920 transno 8589950831 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.658897:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.658960:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bb6e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e89e expref: 140 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658979:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bb83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e89e expref: 139 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.658988:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:3.0:1777580314.658991:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.658994:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00000100:00100000:3.0:1777580314.659107:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283224:x1863919946698752:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9351us (24975us total) trans 8589950831 rc 0/0 00000100:00100000:3.0:1777580314.659125:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19624 00000100:00100000:1.0:1777580314.659562:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283275:x1863919946699008:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1840us (17723us total) trans 8589950832 rc 0/0 00000100:00100000:1.0:1777580314.659571:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19625 00000100:00100000:1.0:1777580314.659577:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835598680035 time 7835606547573 state 0x2 ref 0 00000100:00100000:3.0:1777580314.663579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.663793:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946699264 00000100:00100000:3.0:1777580314.669208:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946699264 00000100:00100000:3.0:1777580314.669276:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835598680035 time 7835606547573 state 0x0 ref 1 00000100:00100000:3.0:1777580314.669293:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835606647573 time 7835606547573 state 0x1 ref 1 00000100:00100000:3.0:1777580314.669335:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835606647573 time 7835618196117 state 0x0 ref 1 00000100:00100000:3.0:1777580314.669353:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283282:x1863919946699264:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.669379:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.669420:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8a5 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669613:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669631:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669644:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669664:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669671:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.669692:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.670604:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15be:0x0], index 1: 0 00010000:00010000:3.0:1777580314.672530:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bbad lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672558:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bbad lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672573:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bbad lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672635:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672643:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672651:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672657:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.672662:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672671:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672684:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.672688:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.672710:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.672718:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bb9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.672740:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a394054e reply state 00000000fd0359c4 transno 8589950833 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.672752:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.675069:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bb98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8a5 expref: 395 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.675112:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bbad lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8a5 expref: 394 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.675125:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa02498aac800) 00010000:00010000:3.0:1777580314.675129:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.675152:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc7600, rc 0) 00000100:00100000:3.0:1777580314.675274:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283282:x1863919946699264:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5926us (11707us total) trans 8589950833 rc 0/0 00000100:00100000:3.0:1777580314.675300:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19626 00000100:00100000:3.0:1777580314.675310:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835606647573 time 7835618196117 state 0x2 ref 0 00010000:00010000:3.0:1777580314.682891:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682914:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682923:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682940:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.682947:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682955:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682979:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.682982:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.682989:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.682997:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bb7c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.697977:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.698019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.698088:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.698110:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.698174:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946699520 00000100:00100000:1.0:1777580314.698187:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946699520 00000100:00100000:2.0:1777580314.698238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.698240:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835606647573 time 7835618196117 state 0x0 ref 1 00000100:00100000:1.0:1777580314.699606:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835618296117 time 7835618196117 state 0x1 ref 1 00000100:00100000:1.0:1777580314.708523:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946699776 00000100:00100000:1.0:1777580314.708546:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946699776 00000100:00100000:1.0:1777580314.708618:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835618296117 time 7835618196117 state 0x1 ref 2 00000100:00100000:1.0:1777580314.708641:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700032 00000100:00100000:1.0:1777580314.708645:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700032 00000100:00100000:1.0:1777580314.708661:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835618296117 time 7835618196117 state 0x1 ref 3 00000100:00100000:1.0:1777580314.708678:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700288 00000100:00100000:1.0:1777580314.708702:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700288 00000100:00100000:1.0:1777580314.708722:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835618296117 time 7835618196117 state 0x1 ref 4 00000100:00100000:1.0:1777580314.708732:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700416 00000100:00100000:1.0:1777580314.708735:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700416 00000100:00100000:1.0:1777580314.708746:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835618296117 time 7835618196117 state 0x1 ref 5 00000100:00100000:1.0:1777580314.708764:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835657725929 time 7835657625929 state 0x1 ref 5 00000100:00100000:1.0:1777580314.708785:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283224:x1863919946699520:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.708905:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.708946:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bb83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e89e expref: 140 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.708972:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:1.0:1777580314.708986:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.709091:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709108:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709121:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.709358:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fa201654 reply state 00000000b985ba9f transno 8589950834 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.709369:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.709504:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283224:x1863919946699520:12345-192.168.202.9@tcp:36:touch.500 Request processed in 726us (11540us total) trans 8589950834 rc 0/0 00000100:00100000:1.0:1777580314.709525:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19627 00000100:00100000:1.0:1777580314.709556:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835658518362 time 7835658418362 state 0x1 ref 4 00000100:00100000:1.0:1777580314.709569:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283231:x1863919946699776:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.709583:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.709596:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bbc2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8ac expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709723:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709734:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709742:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709758:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709766:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.709772:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580314.710402:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e3:0x0], index 0: 0 00010000:00010000:1.0:1777580314.710604:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bbd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710631:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710642:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710687:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710695:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710702:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710709:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.710714:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710723:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710737:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.710740:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.710745:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710752:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bbc9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.710768:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000063cff5b9 reply state 000000005eacda88 transno 8589950835 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.710783:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580314.710839:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bbc2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ac expref: 143 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710855:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ac expref: 142 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.710863:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa0241785f800) 00010000:00010000:1.0:1777580314.710866:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.710870:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997e600, rc 0) 00000100:00100000:1.0:1777580314.710938:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283231:x1863919946699776:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1371us (12918us total) trans 8589950835 rc 0/0 00000100:00100000:1.0:1777580314.710948:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19628 00000100:00100000:1.0:1777580314.710988:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835659949240 time 7835659849240 state 0x1 ref 3 00000100:00100000:1.0:1777580314.711003:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283282:x1863919946700032:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580314.711048:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580314.711063:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bbad lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8a5 expref: 397 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711074:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa02498aac800) 00010000:00010000:1.0:1777580314.711083:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580314.711183:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711193:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711209:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580314.711302:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000022a74a15 reply state 00000000448ccb89 transno 8589950836 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580314.711311:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580314.711352:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283282:x1863919946700032:12345-192.168.202.9@tcp:36:touch.500 Request processed in 352us (13263us total) trans 8589950836 rc 0/0 00000100:00100000:1.0:1777580314.711359:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19629 00000100:00100000:1.0:1777580314.711375:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835660337867 time 7835660237867 state 0x1 ref 2 00000100:00100000:1.0:1777580314.711384:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283281:x1863919946700288:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580314.711395:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580314.711408:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4bbec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8b3 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711517:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711528:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711536:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711548:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711567:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711575:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711636:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4bc01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711646:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4bc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711653:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4bc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580314.711661:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81d:0x0]: returning size 0 00010000:00010000:1.0:1777580314.711707:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711715:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711721:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711728:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580314.711731:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711739:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711760:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580314.711762:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.711767:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711774:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4bbf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711786:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711792:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711799:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.711804:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7000 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:0.0:1777580314.714058:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835660337867 time 7835662906907 state 0x0 ref 2 00000100:00100000:0.0:1777580314.714104:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:283275:x1863919946700416:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.714153:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.714181:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bc0f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8ba expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.714259:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bc0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ba expref: 400 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.714278:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bc0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ba expref: 400 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.714317:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa024989ec400) 00010000:00010000:0.0:1777580314.714321:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580314.714325:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69bf600, rc 0) 00000100:00100000:0.0:1777580314.714407:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283275:x1863919946700416:12345-192.168.202.9@tcp:101:touch.500 Request processed in 325us (16168us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.714416:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19631 00010000:00010000:3.0:1777580314.715571:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715589:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715598:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715604:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.715610:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715618:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715655:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa024989ec400) 00010000:00010000:3.0:1777580314.715658:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.715663:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715670:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bb91 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715698:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715704:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715710:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715715:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.715719:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715725:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715731:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02490544700) 00010000:00010000:3.0:1777580314.715734:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.715736:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.715742:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bba6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719435:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719459:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719481:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0241785f600) 00010000:00010000:1.0:1777580314.719484:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580314.719489:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719497:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4bbfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719616:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4bbec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8b3 expref: 398 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719634:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4bc01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8b3 expref: 397 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580314.719642:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:1.0:1777580314.719645:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580314.719648:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6600, rc 0) 00000100:00100000:1.0:1777580314.719745:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283281:x1863919946700288:12345-192.168.202.9@tcp:101:touch.500 Request processed in 8360us (21632us total) trans 8589950837 rc 0/0 00000100:00100000:1.0:1777580314.719757:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19630 00000100:00100000:1.0:1777580314.719766:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835660337867 time 7835662906907 state 0x2 ref 0 00010000:00010000:3.0:1777580314.723355:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.723377:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729106:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729148:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.729156:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729167:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729189:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580314.729193:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.729199:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729207:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bbbb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729264:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729273:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729280:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729296:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.729300:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729305:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729314:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0241785f100) 00010000:00010000:3.0:1777580314.729317:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.729319:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.729324:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bbd0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.738228:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738321:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738342:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738359:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.738396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580314.738439:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738452:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738460:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738474:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.738481:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738490:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738513:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa0241785f000) 00010000:00010000:3.0:1777580314.738517:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.738522:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738529:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bbe5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.738588:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700672 00000100:00100000:3.0:1777580314.738600:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700672 00000100:00100000:3.0:1777580314.738651:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835660337867 time 7835662906907 state 0x0 ref 1 00000100:00100000:3.0:1777580314.738664:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 1 00000100:00100000:3.0:1777580314.738684:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700800 00000100:00100000:3.0:1777580314.738687:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700800 00000100:00100000:3.0:1777580314.738700:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 2 00000100:00100000:3.0:1777580314.738712:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946701184 00000100:00100000:3.0:1777580314.738714:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946701184 00000100:00100000:3.0:1777580314.738723:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 3 00000100:00100000:3.0:1777580314.738729:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946701440 00000100:00100000:3.0:1777580314.738737:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946701440 00000100:00100000:3.0:1777580314.738750:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 4 00000100:00100000:3.0:1777580314.738757:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946701696 00000100:00100000:3.0:1777580314.738759:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946701696 00000100:00100000:3.0:1777580314.738768:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 5 00000100:00100000:3.0:1777580314.738774:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946701824 00000100:00100000:3.0:1777580314.738783:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946701824 00000100:00100000:3.0:1777580314.738792:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835663006907 time 7835662906907 state 0x1 ref 6 00000100:00100000:3.0:1777580314.738804:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835687767181 time 7835687667181 state 0x1 ref 6 00000100:00100000:3.0:1777580314.738828:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283281:x1863919946700672:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.738904:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580314.738926:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4bc01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8b3 expref: 398 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.738938:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580314.738941:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.739033:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739049:0:205914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 143 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739058:0:205914:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739103:0:205914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 143 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739124:0:205914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 143 pid: 191688 timeout: 7935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.739163:0:205914:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238639ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205914:1863919917478144:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580314.739273:0:205914:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738600 going to sleep for 11 seconds 00000100:00100000:3.0:1777580314.739297:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835688259822 time 7835688159822 state 0x1 ref 6 00000100:00100000:3.0:1777580314.739309:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283224:x1863919946700800:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.739333:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.739349:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bc1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8c1 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739394:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bc1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c1 expref: 144 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739409:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bc1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c1 expref: 144 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739426:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa02498aace00) 00010000:00010000:3.0:1777580314.739429:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.739431:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4600, rc 0) 00000100:00100000:3.0:1777580314.739469:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283224:x1863919946700800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 161us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.739477:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19633 00000100:00100000:3.0:1777580314.739499:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835688463151 time 7835688363151 state 0x1 ref 5 00000100:00100000:3.0:1777580314.739514:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283231:x1863919946701184:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.739536:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580314.739548:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bbd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ac expref: 143 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739559:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa0241785f800) 00010000:00010000:3.0:1777580314.739566:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.739614:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739623:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.739631:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.739798:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005a94e5d2 reply state 00000000481a8bfa transno 8589950838 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.739822:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.739883:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283231:x1863919946701184:12345-192.168.202.9@tcp:36:touch.500 Request processed in 369us (1561us total) trans 8589950838 rc 0/0 00000100:00100000:3.0:1777580314.739890:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19634 00000100:00100000:3.0:1777580314.739907:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835688870402 time 7835688770402 state 0x1 ref 4 00000100:00100000:3.0:1777580314.739917:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283283:x1863919946701440:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.739926:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.739943:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc2b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8c8 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740060:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740071:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740079:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740093:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740100:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.740106:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580314.740670:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15bf:0x0], index 1: 0 00010000:00010000:3.0:1777580314.745252:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4bc40 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.745281:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747151:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747244:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747276:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747297:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747304:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.747309:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747317:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747333:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.747336:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.747342:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747348:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc32 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.747367:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c02dafaa reply state 000000006dd63aee transno 8589950839 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.747377:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.747573:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc2b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c8 expref: 400 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747594:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4bc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c8 expref: 399 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.747614:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024b7eb0500) 00010000:00010000:3.0:1777580314.747616:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.747619:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5000, rc 0) 00000100:00100000:3.0:1777580314.747704:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283283:x1863919946701440:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7787us (9360us total) trans 8589950839 rc 0/0 00000100:00100000:3.0:1777580314.747715:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19635 00000100:00100000:3.0:1777580314.747774:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835696733661 time 7835696633661 state 0x1 ref 3 00000100:00100000:3.0:1777580314.748066:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283235:x1863919946701696:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.748089:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.748109:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4bc4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8cf expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748324:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748341:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748351:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748367:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748374:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.748707:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.751556:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835696733661 time 7835700407481 state 0x0 ref 3 00000100:00100000:0.0:1777580314.751598:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:283282:x1863919946701824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580314.751634:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.751667:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bc63 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8d6 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.751741:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8d6 expref: 400 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.751760:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bc63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8d6 expref: 400 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.751789:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580314.751792:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580314.751797:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69bec00, rc 0) 00000100:00100000:0.0:1777580314.751887:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283282:x1863919946701824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 308us (13499us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.751896:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19637 00000004:00080000:3.0:1777580314.754011:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e4:0x0], index 0: 0 00010000:00010000:3.0:1777580314.754358:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4bc6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754381:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754409:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754461:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754469:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754476:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754483:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.754488:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754497:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754511:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.754515:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.754539:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754546:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.754563:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e3f7c7f0 reply state 00000000ba2bb222 transno 8589950840 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.754573:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580314.754628:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4bc4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8cf expref: 146 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754645:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8cf expref: 145 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.754653:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa024b7eb0100) 00010000:00010000:3.0:1777580314.754655:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.754657:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4000, rc 0) 00000100:00100000:3.0:1777580314.754742:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283235:x1863919946701696:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6687us (16380us total) trans 8589950840 rc 0/0 00000100:00100000:0.0:1777580314.758846:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946700928 00000100:00100000:0.0:1777580314.758860:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946700928 00000100:00100000:0.0:1777580314.758946:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11984 00000100:00100000:0.0:1777580314.758958:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946700928:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580314.759408:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2362:x1863919946700928:12345-192.168.202.9@tcp:2:touch.500 Request processed in 452us (21120us total) trans 8589938623 rc 0/0 00000100:00100000:0.0:1777580314.759419:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11984 00000100:00100000:3.0:1777580314.766530:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19636 00000100:00100000:0.0:1777580314.766938:0:205914:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238639ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205914:1863919917478144:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580314.766978:0:205914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.768205:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:3.0:1777580314.768909:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777580314.771925:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946701952 00000100:00100000:2.0:1777580314.771947:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946701952 00010000:00010000:2.0:1777580314.772010:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 146 pid: 191688 timeout: 7935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.772062:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4407 00000100:00100000:2.0:1777580314.772074:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:2361:x1863919946701952:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580314.772092:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580314.772109:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 146 pid: 191688 timeout: 7935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772125:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 146 pid: 191688 timeout: 7935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772186:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4b90d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e1 expref: 146 pid: 191688 timeout: 7935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772204:0:206357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580314.772211:0:206357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772222:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772230:0:206357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772264:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580314.772348:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:2361:x1863919946701952:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 275us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.772357:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4407 00010000:00010000:3.0:1777580314.772543:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772554:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772562:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772579:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.772585:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772593:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772603:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa02498aac600) 00010000:00010000:3.0:1777580314.772605:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.772607:0:205914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772609:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772616:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bc24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.772616:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772692:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772698:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772703:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772708:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.772711:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772717:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772737:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0248e788600) 00010000:00010000:3.0:1777580314.772740:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.772743:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772748:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bc39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.772773:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.772843:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002b02edd9 reply state 00000000753dff19 transno 8589950841 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.772860:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580314.772967:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283281:x1863919946700672:12345-192.168.202.9@tcp:36:touch.500 Request processed in 34139us (34752us total) trans 8589950841 rc 0/0 00000100:00100000:2.0:1777580314.772977:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19632 00000100:00100000:2.0:1777580314.772986:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835696733661 time 7835700407481 state 0x2 ref 0 00010000:00010000:3.0:1777580314.774709:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.774719:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.774725:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.774731:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.774740:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.774758:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024b7eb0e00) 00010000:00010000:3.0:1777580314.774762:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.774767:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.774774:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bc5c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.776759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.779323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.779374:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946702336 00000100:00100000:1.0:1777580314.779472:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946702208 00000100:00100000:1.0:1777580314.779484:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946702208 00000100:00100000:1.0:1777580314.779544:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4206 00000100:00100000:1.0:1777580314.779555:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283275:x1863919946702208:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.781764:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+401:283275:x1863919946702208:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2196us (4999us total) trans 8589950842 rc 0/0 00000100:00100000:1.0:1777580314.783131:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4206 00000100:00100000:3.0:1777580314.813486:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946702336 00000100:00100000:3.0:1777580314.813617:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11985 00000100:00100000:3.0:1777580314.813630:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2364:x1863919946702336:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.814174:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2364:x1863919946702336:12345-192.168.202.9@tcp:2:touch.500 Request processed in 545us (34861us total) trans 8589938624 rc 0/0 00000100:00100000:3.0:1777580314.814183:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11985 00000100:00100000:3.0:1777580314.814314:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814405:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814483:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814524:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814545:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814566:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.814767:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703744 00000100:00100000:3.0:1777580314.814775:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703744 00000100:00100000:3.0:1777580314.814831:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11986 00000100:00100000:3.0:1777580314.814841:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2363:x1863919946703744:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580314.815104:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946703744:12345-192.168.202.9@tcp:2:touch.500 Request processed in 264us (509us total) trans 8589939025 rc 0/0 00000100:00100000:3.0:1777580314.815166:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11986 00000100:00100000:3.0:1777580314.815196:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946702464 00000100:00100000:3.0:1777580314.815200:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946702464 00000100:00100000:3.0:1777580314.815226:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835696733661 time 7835700407481 state 0x0 ref 1 00000100:00100000:3.0:1777580314.815239:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835700507481 time 7835700407481 state 0x1 ref 1 00000100:00100000:3.0:1777580314.815251:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946702720 00000100:00100000:3.0:1777580314.815254:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946702720 00000100:00100000:3.0:1777580314.815265:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835700507481 time 7835700407481 state 0x1 ref 2 00000100:00100000:3.0:1777580314.815273:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946702976 00000100:00100000:3.0:1777580314.815275:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946702976 00000100:00100000:3.0:1777580314.815286:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835700507481 time 7835700407481 state 0x1 ref 3 00000100:00100000:3.0:1777580314.815295:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835764257689 time 7835764157689 state 0x1 ref 3 00000100:00100000:3.0:1777580314.815303:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283231:x1863919946702464:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.815320:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.815348:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4bc78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8dd expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815413:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4bc78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8dd expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815430:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4bc78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8dd expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815468:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa024b7eb0b00) 00010000:00010000:3.0:1777580314.815471:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.815475:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680ee00, rc 0) 00000100:00100000:3.0:1777580314.815496:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283231:x1863919946702464:12345-192.168.202.9@tcp:101:touch.500 Request processed in 193us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.815504:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19638 00000100:00100000:3.0:1777580314.815518:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703104 00000100:00100000:3.0:1777580314.815522:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703104 00000100:00100000:3.0:1777580314.815533:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835498804973 time 7835521701125 state 0x0 ref 1 00000100:00100000:3.0:1777580314.815540:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835521801125 time 7835521701125 state 0x1 ref 1 00000100:00100000:3.0:1777580314.815547:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703232 00000100:00100000:3.0:1777580314.815549:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703232 00000100:00100000:3.0:1777580314.815559:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835521801125 time 7835521701125 state 0x1 ref 2 00000100:00100000:3.0:1777580314.815565:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703360 00000100:00100000:3.0:1777580314.815568:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703360 00000100:00100000:3.0:1777580314.815577:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835521801125 time 7835521701125 state 0x1 ref 3 00000100:00100000:3.0:1777580314.815583:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703488 00000100:00100000:3.0:1777580314.815586:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703488 00000100:00100000:3.0:1777580314.815593:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835521801125 time 7835521701125 state 0x1 ref 4 00000100:00100000:3.0:1777580314.815599:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703616 00000100:00100000:3.0:1777580314.815601:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703616 00000100:00100000:3.0:1777580314.815610:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835521801125 time 7835521701125 state 0x1 ref 5 00000100:00100000:3.0:1777580314.815615:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946703872 00000100:00100000:3.0:1777580314.815624:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946703872 00000100:00100000:3.0:1777580314.815637:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835764257689 time 7835764157689 state 0x1 ref 3 00000100:00100000:3.0:1777580314.815647:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835764611089 time 7835764511089 state 0x1 ref 5 00000100:00100000:3.0:1777580314.815655:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283246:x1863919946703104:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.815663:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.815673:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4bc7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8e4 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815732:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815744:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815754:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815770:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815777:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815783:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815922:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815932:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.815948:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580314.815982:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x824:0x0]: returning size 0 00000004:00200000:3.0:1777580314.815987:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.816008:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816022:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816032:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816040:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816047:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816056:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.816060:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816069:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816081:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.816084:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.816088:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816105:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4e00/0xcb2b2f2f7e4bc86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816120:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816127:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816165:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816171:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.816174:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816181:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816190:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024b7eb0300) 00010000:00010000:3.0:1777580314.816192:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.816195:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816201:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bc8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816241:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4400/0xcb2b2f2f7e4bc7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8e4 expref: 151 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816268:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8e4 expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816275:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:3.0:1777580314.816278:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.816280:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e87a00, rc 0) 00000100:00100000:3.0:1777580314.816319:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283246:x1863919946703104:12345-192.168.202.9@tcp:101:rm.500 Request processed in 664us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.816327:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19641 00000100:00100000:3.0:1777580314.816355:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835765317093 time 7835765217093 state 0x1 ref 3 00000100:00100000:3.0:1777580314.816368:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:283283:x1863919946702720:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.816424:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580314.816441:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4bc40 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c8 expref: 402 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816453:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024b7eb0500) 00010000:00010000:3.0:1777580314.816461:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.816526:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816535:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.816542:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.816700:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cee74506 reply state 00000000038f4e08 transno 8589950843 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.816712:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.816764:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:283283:x1863919946702720:12345-192.168.202.9@tcp:36:touch.500 Request processed in 397us (2357us total) trans 8589950843 rc 0/0 00000100:00100000:3.0:1777580314.816771:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19639 00000100:00100000:3.0:1777580314.816791:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835765753771 time 7835765653771 state 0x1 ref 4 00000100:00100000:3.0:1777580314.816802:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283264:x1863919946703232:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.823939:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.823974:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bca2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8eb expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824069:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824086:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824100:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824116:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824123:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824163:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824319:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824329:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.824337:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580314.824369:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x827:0x0]: returning size 0 00000004:00200000:3.0:1777580314.824373:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.825877:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825911:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825924:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825931:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825937:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825944:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.825949:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825967:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.825973:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.825980:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825984:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.825985:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825987:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.825990:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.825992:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.825993:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.825998:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.825999:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4bca9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826007:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580314.826009:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.826012:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826014:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826019:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826019:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4bc16 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826025:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826031:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.826034:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826039:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826045:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024b7eb0e00) 00010000:00010000:3.0:1777580314.826048:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.826050:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826060:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bcb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.826081:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775038683 time 7835774938683 state 0x1 ref 2 00000100:00100000:2.0:1777580314.826108:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283235:x1863919946702976:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580314.826112:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4bca2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8eb expref: 151 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826126:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8eb expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826149:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:3.0:1777580314.826152:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.826155:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00010000:00010000:2.0:1777580314.826182:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580314.826198:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4000/0xcb2b2f2f7e4bc6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8cf expref: 150 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826208:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa024b7eb0100) 00010000:00010000:2.0:1777580314.826217:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580314.826229:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283264:x1863919946703232:12345-192.168.202.9@tcp:101:rm.500 Request processed in 9429us (11724us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.826236:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19642 00000100:00100000:3.0:1777580314.826270:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775232608 time 7835775132608 state 0x1 ref 3 00000100:00100000:3.0:1777580314.826281:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283247:x1863919946703360:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.826291:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.826296:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826302:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bcc5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8f2 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826308:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826320:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826345:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826354:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826370:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.826381:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580314.826494:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c3ea2d5f reply state 00000000f5b4cf6f transno 8589950844 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.826505:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580314.826560:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283235:x1863919946702976:12345-192.168.202.9@tcp:36:touch.500 Request processed in 465us (12098us total) trans 8589950844 rc 0/0 00000100:00100000:2.0:1777580314.826567:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19640 00000100:00100000:2.0:1777580314.826584:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775038683 time 7835775447443 state 0x0 ref 1 00000100:00100000:2.0:1777580314.826595:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+401:283281:x1863919946703872:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580314.826614:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.826624:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bcda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e907 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826658:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bcda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e907 expref: 402 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826668:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bcda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e907 expref: 402 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826685:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580314.826687:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580314.826690:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1a00, rc 0) 00000100:00100000:2.0:1777580314.826712:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:283281:x1863919946703872:12345-192.168.202.9@tcp:101:touch.500 Request processed in 118us (12044us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.826719:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19646 00000100:00100000:2.0:1777580314.826723:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775038683 time 7835775447443 state 0x2 ref 0 00000100:00100000:2.0:1777580314.826742:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775706064 time 7835775606064 state 0x1 ref 3 00000100:00100000:2.0:1777580314.826752:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283268:x1863919946703488:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.826761:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.826769:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4bce1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e8f9 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826798:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826834:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826842:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826856:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826864:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826870:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826979:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826988:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.826995:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.827018:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x828:0x0]: returning size 0 00000004:00200000:2.0:1777580314.827022:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.827038:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827046:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827061:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827067:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827073:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827079:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.827082:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827088:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827097:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.827099:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.827102:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827109:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4bce8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827117:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827123:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827128:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827158:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.827161:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827166:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827174:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02488b77500) 00010000:00010000:2.0:1777580314.827177:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.827179:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827184:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4bcef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827209:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4bce1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f9 expref: 152 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827218:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f9 expref: 151 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827224:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:2.0:1777580314.827227:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.827229:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:2.0:1777580314.827252:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283268:x1863919946703488:12345-192.168.202.9@tcp:101:rm.500 Request processed in 501us (12706us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.827257:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19644 00000100:00100000:2.0:1777580314.827275:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775706064 time 7835776138244 state 0x0 ref 2 00000100:00100000:2.0:1777580314.827293:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283277:x1863919946703616:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.827301:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.827309:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4bcfd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e900 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827335:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827343:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827350:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827362:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827368:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827375:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827425:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827433:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827440:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.827469:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x829:0x0]: returning size 0 00000004:00200000:2.0:1777580314.827472:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.827481:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827489:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827496:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827501:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827507:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827512:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.827514:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827520:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827527:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.827529:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.827532:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827537:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4bd04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827557:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827564:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827569:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827574:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.827577:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827583:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827591:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa024c6346000) 00010000:00010000:3.0:1777580314.827594:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827594:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.827596:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827602:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4bd0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827603:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827626:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4bcfd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e900 expref: 152 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827638:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e900 expref: 151 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827657:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580314.827658:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.827659:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.827662:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9c00, rc 0) 00010000:00010000:3.0:1777580314.827666:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827672:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.827678:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283277:x1863919946703616:12345-192.168.202.9@tcp:101:rm.500 Request processed in 389us (13112us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.827684:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19645 00000004:00200000:3.0:1777580314.827691:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x825:0x0]: returning size 0 00000004:00200000:3.0:1777580314.827693:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.827702:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827710:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827716:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827732:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827738:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827743:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.827745:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827756:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827765:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.827767:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.827770:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827789:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bccc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827800:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827814:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827819:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827824:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.827833:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827840:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827847:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02490544700) 00010000:00010000:3.0:1777580314.827850:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.827852:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827857:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bcd3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827882:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bcc5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 151 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827893:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.827899:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:3.0:1777580314.827901:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.827903:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997ea00, rc 0) 00000100:00100000:3.0:1777580314.827921:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283247:x1863919946703360:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1642us (13397us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.827928:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19643 00000100:00100000:3.0:1777580314.827931:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775706064 time 7835776138244 state 0x2 ref 0 00000100:00100000:3.0:1777580314.836369:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.837043:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580314.837874:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704128 00000100:00100000:1.0:1777580314.837890:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704128 00000100:00100000:1.0:1777580314.837960:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4207 00000100:00100000:1.0:1777580314.837970:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+402:283282:x1863919946704128:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.841519:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+403:283282:x1863919946704128:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3534us (5147us total) trans 8589950845 rc 0/0 00000100:00100000:1.0:1777580314.841536:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4207 00000100:00100000:0.0:1777580314.843946:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704256 00000100:00100000:0.0:1777580314.843968:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704256 00000100:00100000:0.0:1777580314.844068:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11987 00000100:00100000:0.0:1777580314.844082:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2363:x1863919946704256:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.844108:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.844154:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e90e expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580314.844194:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15de:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580314.844222:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.844225:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.844235:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 41 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.844259:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 41 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.844303:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69be400, rc 0) 00000100:00100000:0.0:1777580314.844375:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2363:x1863919946704256:12345-192.168.202.9@tcp:101:rm.500 Request processed in 297us (7335us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.844383:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11987 00000100:00100000:3.0:1777580314.858588:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858704:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858826:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858969:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.858989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.859010:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.859061:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.859090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.859271:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704384 00000100:00100000:3.0:1777580314.859283:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704384 00000100:00100000:3.0:1777580314.859335:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775706064 time 7835776138244 state 0x0 ref 1 00000100:00100000:3.0:1777580314.859352:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835776238244 time 7835776138244 state 0x1 ref 1 00000100:00100000:3.0:1777580314.859374:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705280 00000100:00100000:3.0:1777580314.859377:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705280 00000100:00100000:3.0:1777580314.859392:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775038683 time 7835775447443 state 0x0 ref 1 00000100:00100000:3.0:1777580314.859399:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775547443 time 7835775447443 state 0x1 ref 1 00000100:00100000:3.0:1777580314.859412:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705408 00000100:00100000:3.0:1777580314.859415:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705408 00000100:00100000:3.0:1777580314.859428:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835775547443 time 7835775447443 state 0x1 ref 2 00000100:00100000:3.0:1777580314.859440:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705792 00000100:00100000:3.0:1777580314.859443:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705792 00000100:00100000:3.0:1777580314.859455:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835776238244 time 7835776138244 state 0x1 ref 2 00000100:00100000:3.0:1777580314.859491:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808452471 time 7835808352471 state 0x1 ref 2 00000100:00100000:3.0:1777580314.859504:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:283283:x1863919946705280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.859535:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.859563:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bd27 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e92a expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859649:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bd27 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e92a expref: 405 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859668:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bd27 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e92a expref: 405 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859692:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580314.859695:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.859699:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fa00, rc 0) 00000100:00100000:3.0:1777580314.859769:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+405:283283:x1863919946705280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 266us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.859777:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19648 00000100:00100000:3.0:1777580314.859804:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808767589 time 7835808667589 state 0x1 ref 2 00000100:00100000:3.0:1777580314.859830:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:283289:x1863919946704384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580314.859838:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.859849:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bd2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e915 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859928:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859938:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859946:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859960:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859966:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.859971:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860100:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860109:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860116:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580314.860163:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7fa:0x0]: returning size 0 00000004:00200000:3.0:1777580314.860168:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580314.860192:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860215:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860225:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860232:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860239:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860245:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.860249:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860257:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860269:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.860272:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.860277:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860283:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bd35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860296:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860302:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860313:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860320:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.860324:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860330:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860337:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02490544700) 00010000:00010000:3.0:1777580314.860339:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.860341:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860347:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bd3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860382:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bd2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e915 expref: 406 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860393:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e915 expref: 405 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860400:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa024989ec400) 00010000:00010000:3.0:1777580314.860402:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580314.860405:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997f400, rc 0) 00000100:00100000:3.0:1777580314.860433:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+405:283289:x1863919946704384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 604us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.860447:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19647 00000100:00100000:3.0:1777580314.860470:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808452471 time 7835809332364 state 0x0 ref 1 00000100:00100000:3.0:1777580314.860481:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283235:x1863919946705408:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580314.860496:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580314.860506:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bd4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e931 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860540:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bd4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e931 expref: 152 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860550:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bd4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e931 expref: 152 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860563:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02488b77800) 00010000:00010000:3.0:1777580314.860566:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580314.860568:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86a00, rc 0) 00000100:00100000:3.0:1777580314.860589:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:283235:x1863919946705408:12345-192.168.202.9@tcp:101:touch.500 Request processed in 110us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580314.860596:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19649 00000100:00100000:3.0:1777580314.860600:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808452471 time 7835809332364 state 0x2 ref 0 00000100:00100000:3.0:1777580314.860619:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808767589 time 7835809482239 state 0x0 ref 1 00000100:00100000:3.0:1777580314.860627:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283223:x1863919946705792:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580314.860660:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580314.860679:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4b930 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7e8 expref: 151 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860694:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4b6eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e747 expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860705:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:3.0:1777580314.860713:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.860724:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860732:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860739:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860756:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860764:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.860770:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.864016:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704512 00000100:00100000:2.0:1777580314.864037:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704512 00000100:00100000:2.0:1777580314.864115:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704896 00000100:00100000:2.0:1777580314.864119:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704896 00000100:00100000:2.0:1777580314.864157:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705152 00000100:00100000:2.0:1777580314.864161:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705152 00000100:00100000:2.0:1777580314.864182:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705024 00000100:00100000:2.0:1777580314.864186:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705024 00000100:00100000:2.0:1777580314.864203:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705536 00000100:00100000:2.0:1777580314.864206:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705536 00000100:00100000:2.0:1777580314.864225:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946705920 00000100:00100000:2.0:1777580314.864228:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946705920 00000100:00100000:2.0:1777580314.864258:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11988 00000100:00100000:2.0:1777580314.864270:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946704512:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580314.864688:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946704512:12345-192.168.202.9@tcp:2:touch.500 Request processed in 418us (5980us total) trans 8589939026 rc 0/0 00000100:00100000:2.0:1777580314.864697:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11988 00000100:00100000:2.0:1777580314.864721:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11989 00000100:00100000:2.0:1777580314.864729:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2363:x1863919946704896:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.864745:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.864795:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e91c expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.864841:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ba:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.864859:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.864861:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.864872:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.864892:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.864908:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8800, rc 0) 00000100:00100000:2.0:1777580314.864932:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2363:x1863919946704896:12345-192.168.202.9@tcp:101:rm.500 Request processed in 203us (6038us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.864939:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11989 00000100:00100000:2.0:1777580314.864953:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11990 00000100:00100000:2.0:1777580314.864960:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2364:x1863919946705152:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:2.0:1777580314.865112:0:205900:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x15b6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777580314.865116:0:205900:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x15b6:0x0] updating lvb mtime from disk: 1777580313 -> 1777580313 00002000:00010000:2.0:1777580314.865119:0:205900:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x15b6:0x0] updating lvb atime from disk: 1777580313 -> 1777580313 00002000:00010000:2.0:1777580314.865122:0:205900:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x15b6:0x0] updating lvb ctime from disk: 1777580313 -> 1777580313 00002000:00010000:2.0:1777580314.865124:0:205900:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x15b6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1777580314.865172:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2364:x1863919946705152:12345-192.168.202.9@tcp:2:touch.500 Request processed in 213us (6247us total) trans 8589938625 rc 0/0 00000100:00100000:2.0:1777580314.865179:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11990 00000100:00100000:2.0:1777580314.865200:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11991 00000100:00100000:2.0:1777580314.865208:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2364:x1863919946705024:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.865216:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.865230:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e923 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.865245:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15bb:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.865254:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865256:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865261:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865272:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865281:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8400, rc 0) 00000100:00100000:2.0:1777580314.865302:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2364:x1863919946705024:12345-192.168.202.9@tcp:101:rm.500 Request processed in 96us (6355us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.865308:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11991 00000100:00100000:2.0:1777580314.865320:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11992 00000100:00100000:2.0:1777580314.865326:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946705536:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.865333:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.865343:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e938 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.865357:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15bc:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.865374:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865376:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865381:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865393:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865403:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9200, rc 0) 00000100:00100000:2.0:1777580314.865424:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946705536:12345-192.168.202.9@tcp:101:rm.500 Request processed in 98us (6364us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.865431:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11992 00000100:00100000:2.0:1777580314.865445:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11993 00000100:00100000:2.0:1777580314.865453:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946705920:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.865461:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.865476:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e93f expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580314.865492:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e1:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:2.0:1777580314.865502:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865504:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580314.865508:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865521:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 43 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865543:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8e00, rc 0) 00000100:00100000:2.0:1777580314.865559:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946705920:12345-192.168.202.9@tcp:101:rm.500 Request processed in 107us (6469us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.865566:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11993 00010000:00010000:2.0:1777580314.865609:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865619:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865628:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865635:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.865641:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865650:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865667:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580314.865671:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.865676:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865683:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4bcbe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865713:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865728:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865734:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865740:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.865743:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865750:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865760:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024989ec600) 00010000:00010000:2.0:1777580314.865762:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.865765:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.865771:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4bc9b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580314.865797:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946704768 00000100:00100000:2.0:1777580314.865820:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946704768 00000100:00100000:2.0:1777580314.865865:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4208 00000100:00100000:2.0:1777580314.865873:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283224:x1863919946704768:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580314.866216:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283224:x1863919946704768:12345-192.168.202.9@tcp:35:touch.500 Request processed in 341us (7388us total) trans 8589950846 rc 0/0 00000100:00100000:2.0:1777580314.866223:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4208 00010000:00010000:3.0:1777580314.868405:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.868429:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.868463:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580314.869257:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1883, 64 off128704 00010000:00010000:3.0:1777580314.869338:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869350:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869360:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869369:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869376:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869382:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869410:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580314.869440:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869446:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869453:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869472:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.869478:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869486:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869501:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:3.0:1777580314.869504:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580314.869509:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869514:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bd7b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869537:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869544:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869549:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869554:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.869556:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869561:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869580:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.869582:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.869586:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.869592:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bd51 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.869605:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000709af9a5 reply state 0000000018a5eb1c transno 8589950847 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.869614:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.869711:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283223:x1863919946705792:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9078us (10694us total) trans 8589950847 rc 0/0 00000100:00100000:3.0:1777580314.869723:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19650 00000100:00100000:3.0:1777580314.869734:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808767589 time 7835809482239 state 0x2 ref 0 00000100:00100000:3.0:1777580314.870244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580314.896107:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946706048 00000100:00100000:0.0:1777580314.896127:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946706048 00000100:00100000:0.0:1777580314.896197:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808767589 time 7835809482239 state 0x0 ref 1 00000100:00100000:0.0:1777580314.896213:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809582239 time 7835809482239 state 0x1 ref 1 00000100:00100000:0.0:1777580314.896240:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809582239 time 7835845101767 state 0x0 ref 1 00000100:00100000:0.0:1777580314.896259:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+404:283291:x1863919946706048:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.896298:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.896327:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf800/0xcb2b2f2f7e4bd89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e946 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896432:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896451:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896466:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896484:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896502:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896509:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896657:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896667:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896674:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580314.896707:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7fb:0x0]: returning size 0 00000004:00200000:0.0:1777580314.896711:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580314.896735:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896748:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896757:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896763:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896770:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896786:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.896790:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896798:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896824:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.896827:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.896833:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896834:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896840:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69be600/0xcb2b2f2f7e4bd90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896857:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896864:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896864:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896869:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896875:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.896878:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896884:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896886:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896902:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa0248a60e300) 00010000:00010000:0.0:1777580314.896905:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.896908:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896915:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4bd97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896933:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896955:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf800/0xcb2b2f2f7e4bd89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e946 expref: 406 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.896965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580314.896972:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e946 expref: 405 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.896979:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580314.896981:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580314.896984:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248784ce00, rc 0) 00000100:00100000:0.0:1777580314.897063:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+405:283291:x1863919946706048:12345-192.168.202.9@tcp:101:rm.500 Request processed in 813us (26821us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.897073:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19651 00000100:00100000:0.0:1777580314.897080:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809582239 time 7835845101767 state 0x2 ref 0 00000100:00100000:0.0:1777580314.897107:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946706432 00000100:00100000:0.0:1777580314.897115:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946706432 00000100:00100000:0.0:1777580314.897132:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809582239 time 7835845101767 state 0x0 ref 1 00000100:00100000:0.0:1777580314.897161:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835845201767 time 7835845101767 state 0x1 ref 1 00000100:00100000:0.0:1777580314.897194:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835845201767 time 7835846057877 state 0x0 ref 1 00000100:00100000:0.0:1777580314.897206:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283277:x1863919946706432:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580314.897251:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580314.897270:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bd12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x829:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e900 expref: 151 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897286:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4baaa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x829:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e87b expref: 150 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897295:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:0.0:1777580314.897303:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580314.897317:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897326:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897333:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897344:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897351:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.897352:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946706688 00000100:00100000:3.0:1777580314.897356:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946706688 00010000:00010000:0.0:1777580314.897357:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.897398:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946706944 00000100:00100000:3.0:1777580314.897401:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946706944 00000100:00100000:3.0:1777580314.897417:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4209 00000100:00100000:3.0:1777580314.897431:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283231:x1863919946706688:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:0.0:1777580314.897452:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897461:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.897468:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.897776:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283231:x1863919946706688:12345-192.168.202.9@tcp:35:touch.500 Request processed in 345us (888us total) trans 8589950848 rc 0/0 00000100:00100000:3.0:1777580314.897784:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4209 00000100:00100000:3.0:1777580314.897799:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4210 00000100:00100000:3.0:1777580314.897822:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+405:283281:x1863919946706944:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580314.897900:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283281:x1863919946706944:12345-192.168.202.9@tcp:35:touch.500 Request processed in 94us (986us total) trans 8589950849 rc 0/0 00000100:00100000:3.0:1777580314.897907:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4210 00000100:00100000:3.0:1777580314.897929:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946706176 00000100:00100000:3.0:1777580314.897933:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946706176 00000100:00100000:3.0:1777580314.897958:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946707072 00000100:00100000:3.0:1777580314.897961:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946707072 00000100:00100000:3.0:1777580314.897977:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946707200 00000100:00100000:3.0:1777580314.897980:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946707200 00000100:00100000:3.0:1777580314.898004:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11994 00000040:00080000:0.0:1777580314.898009:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1884, 64 off128768 00000100:00100000:3.0:1777580314.898010:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2362:x1863919946706176:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580314.898066:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898075:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898084:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898091:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898097:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898103:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898120:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580314.898158:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898175:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898181:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898187:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580314.898190:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898196:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898206:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580314.898209:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580314.898213:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898219:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51c00/0xcb2b2f2f7e4bdb3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x829:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898236:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898242:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898248:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.898250:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2362:x1863919946706176:12345-192.168.202.9@tcp:2:touch.500 Request processed in 240us (1418us total) trans 8589938626 rc 0/0 00010000:00010000:0.0:1777580314.898253:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:3.0:1777580314.898258:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11994 00010000:00010000:0.0:1777580314.898262:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898269:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.898270:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11995 00000100:00100000:3.0:1777580314.898276:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2364:x1863919946707072:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.898277:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580314.898280:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580314.898283:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.898285:0:206018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.898288:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4bda5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580314.898298:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e3554804 reply state 000000002318ddac transno 8589950850 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.898300:0:206018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e94d expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.898309:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00010000:3.0:1777580314.898330:0:206018:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15bd:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00000100:00100000:0.0:1777580314.898344:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:283277:x1863919946706432:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1142us (1480us total) trans 8589950850 rc 0/0 00010000:00010000:3.0:1777580314.898346:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580314.898348:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1777580314.898351:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19652 00010000:00010000:3.0:1777580314.898355:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 35 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580314.898356:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835845201767 time 7835846057877 state 0x2 ref 0 00010000:00010000:3.0:1777580314.898371:0:206018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 35 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898381:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580314.898382:0:206018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ae00, rc 0) 00010000:00010000:0.0:1777580314.898387:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898394:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.898397:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.898400:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2364:x1863919946707072:12345-192.168.202.9@tcp:101:rm.500 Request processed in 124us (1466us total) trans 0 rc 0/0 00010000:00010000:0.0:1777580314.898404:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.898406:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11995 00000100:00100000:3.0:1777580314.898417:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11996 00010000:00010000:0.0:1777580314.898419:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81e:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:0.0:1777580314.898422:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1777580314.898423:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2362:x1863919946707200:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580314.898425:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898430:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bd82 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898443:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580314.898446:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898452:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.898454:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898460:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898467:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x829:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580314.898469:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580314.898471:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898476:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bdba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x829:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.898489:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.898490:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.898492:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580314.898576:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2362:x1863919946707200:12345-192.168.202.9@tcp:2:touch.500 Request processed in 152us (1608us total) trans 8589939027 rc 0/0 00000100:00100000:3.0:1777580314.898582:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11996 00010000:00010000:3.0:1777580314.898715:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580314.914596:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914626:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914635:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914642:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.914648:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914658:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914681:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580314.914685:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.914692:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.914699:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4bd58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916180:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916199:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916207:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916213:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.916225:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916233:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916248:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0248a60ec00) 00010000:00010000:2.0:1777580314.916251:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.916256:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.916261:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4bdac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.925328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.925463:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.925500:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946707584 00000100:00100000:3.0:1777580314.925513:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946707584 00000100:00100000:3.0:1777580314.925565:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835845201767 time 7835846057877 state 0x0 ref 1 00000100:00100000:3.0:1777580314.925603:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835846157877 time 7835846057877 state 0x1 ref 1 00000100:00100000:3.0:1777580314.925631:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835846157877 time 7835874493385 state 0x0 ref 1 00000100:00100000:3.0:1777580314.925646:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283289:x1863919946707584:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580314.925741:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580314.925793:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bd43 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e915 expref: 406 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925834:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bf600/0xcb2b2f2f7e4bc0f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8ba expref: 405 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925849:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa024989ec400) 00010000:00010000:3.0:1777580314.925864:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.925902:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925919:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925932:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925949:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925956:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.925963:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926201:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926210:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926218:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580314.926847:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1877, 64 off128320 00010000:00010000:3.0:1777580314.926922:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926934:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926943:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926952:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926959:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926966:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.926991:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580314.927016:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927036:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927043:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927051:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.927056:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927065:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927077:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:3.0:1777580314.927080:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580314.927084:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927091:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bdd6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927109:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927116:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927122:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927127:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.927162:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927170:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927178:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.927181:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.927184:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927189:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4bdc8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.927199:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d29e8849 reply state 00000000caab0262 transno 8589950851 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.927209:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.927319:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283289:x1863919946707584:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1672us (1851us total) trans 8589950851 rc 0/0 00000100:00100000:3.0:1777580314.927329:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19653 00000100:00100000:3.0:1777580314.927337:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835846157877 time 7835874493385 state 0x2 ref 0 00010000:00010000:3.0:1777580314.927386:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580314.927392:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927399:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580314.927403:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927410:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927427:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fa:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:3.0:1777580314.927429:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580314.927432:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927438:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bddd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.927452:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.927454:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580314.927456:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580314.929265:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946707328 00000100:00100000:0.0:1777580314.929289:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946707328 00000100:00100000:0.0:1777580314.929367:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11997 00000100:00100000:0.0:1777580314.929379:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+35:2364:x1863919946707328:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580314.929411:0:193009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580314.929439:0:193009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e954 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580314.929473:0:193009:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15be:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580314.929503:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.929506:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580314.929516:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 36 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.929536:0:193009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 36 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.929554:0:193009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb2800, rc 0) 00000100:00100000:0.0:1777580314.929631:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2364:x1863919946707328:12345-192.168.202.9@tcp:101:rm.500 Request processed in 254us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580314.929639:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11997 00000100:00100000:3.0:1777580314.933260:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.940173:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.940328:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946707968 00000100:00100000:3.0:1777580314.940341:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946707968 00000100:00100000:3.0:1777580314.940395:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835846157877 time 7835874493385 state 0x0 ref 1 00000100:00100000:3.0:1777580314.940411:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835874593385 time 7835874493385 state 0x1 ref 1 00000100:00100000:3.0:1777580314.940440:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835874593385 time 7835889301336 state 0x0 ref 1 00000100:00100000:3.0:1777580314.940452:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024a57e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283226:x1863919946707968:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580314.940547:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580314.940588:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4b94c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7ef expref: 150 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940615:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4b746 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e75c expref: 149 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940648:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa02498f4ad00) 00010000:00010000:3.0:1777580314.940663:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.940696:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940711:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940722:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940740:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940748:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940755:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940952:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940961:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.940968:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580314.941573:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1878, 64 off128384 00010000:00010000:3.0:1777580314.941647:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941664:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941673:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941681:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941688:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941695:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941725:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580314.941753:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941760:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941767:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941774:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.941779:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941787:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941824:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa02493bbd000) 00010000:00010000:3.0:1777580314.941828:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580314.941833:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941839:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bdf9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941859:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941865:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941869:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941874:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580314.941877:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941883:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941890:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580314.941892:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580314.941896:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.941901:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bdeb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580314.941922:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cd4e8703 reply state 00000000a9f26f8a transno 8589950852 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580314.941932:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580314.942037:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024a57e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283226:x1863919946707968:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1585us (8787us total) trans 8589950852 rc 0/0 00000100:00100000:3.0:1777580314.942047:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19654 00000100:00100000:3.0:1777580314.942055:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835874593385 time 7835889301336 state 0x2 ref 0 00010000:00010000:2.0:1777580314.942913:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942926:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942933:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942938:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.942942:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942948:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942962:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02493bbdb00) 00010000:00010000:2.0:1777580314.942965:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.942980:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.942986:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bdcf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943638:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580314.943648:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943656:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580314.943660:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943682:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943695:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81f:0x0].0x0 (ffffa02493bbd000) 00010000:00010000:0.0:1777580314.943698:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580314.943701:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943707:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580314.943723:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.943727:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580314.943729:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580314.945736:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946708096 00000100:00100000:2.0:1777580314.945756:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946708096 00000100:00100000:2.0:1777580314.945854:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4211 00000100:00100000:2.0:1777580314.945867:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283235:x1863919946708096:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580314.961483:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283235:x1863919946708096:12345-192.168.202.9@tcp:35:touch.500 Request processed in 15603us (21304us total) trans 8589950853 rc 0/0 00000100:00100000:2.0:1777580314.961499:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4211 00000100:00100000:3.0:1777580314.962080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.962198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.966610:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946708480 00000100:00100000:2.0:1777580314.966635:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946708480 00000100:00100000:2.0:1777580314.966702:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835874593385 time 7835889301336 state 0x0 ref 1 00000100:00100000:2.0:1777580314.966719:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835889401336 time 7835889301336 state 0x1 ref 1 00000100:00100000:2.0:1777580314.966754:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835889401336 time 7835915615051 state 0x0 ref 1 00000100:00100000:2.0:1777580314.966775:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+405:283294:x1863919946708480:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580314.966820:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580314.966851:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e95b expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.966943:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.966984:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.966999:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967020:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967028:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967035:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967213:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967222:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967229:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580314.967264:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81d:0x0]: returning size 0 00000004:00200000:2.0:1777580314.967268:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580314.967293:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967308:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967327:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967333:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967341:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967347:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.967351:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967359:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967372:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580314.967375:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.967381:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967388:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.967400:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968520:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968530:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968549:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580314.968554:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968562:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968576:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024aee2da00) 00010000:00010000:2.0:1777580314.968579:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580314.968582:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968589:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968652:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e95b expref: 407 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968669:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e95b expref: 406 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580314.968677:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580314.968680:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580314.968683:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff0400, rc 0) 00000100:00100000:2.0:1777580314.968797:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283294:x1863919946708480:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2029us (6596us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580314.968819:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19655 00000100:00100000:2.0:1777580314.968829:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835889401336 time 7835915615051 state 0x2 ref 0 00000100:00100000:1.0:1777580314.970001:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946708352 00000100:00100000:1.0:1777580314.970018:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946708352 00000100:00100000:1.0:1777580314.970089:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4212 00000100:00100000:1.0:1777580314.970100:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283283:x1863919946708352:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580314.986344:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283283:x1863919946708352:12345-192.168.202.9@tcp:35:touch.500 Request processed in 16223us (24243us total) trans 8589950854 rc 0/0 00000100:00100000:1.0:1777580314.986365:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4212 00000100:00100000:2.0:1777580314.988221:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580314.988256:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580314.998678:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946708736 00000100:00100000:3.0:1777580314.998701:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946708736 00000100:00100000:3.0:1777580314.998882:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835889401336 time 7835915615051 state 0x0 ref 1 00000100:00100000:3.0:1777580314.998901:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835915715051 time 7835915615051 state 0x1 ref 1 00000100:00100000:3.0:1777580314.998933:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835915715051 time 7835947794703 state 0x0 ref 1 00000100:00100000:3.0:1777580314.998953:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283237:x1863919946708736:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580314.999038:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580314.999074:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4b968 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x822:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7f6 expref: 151 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999099:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4b818 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x822:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7a9 expref: 150 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999159:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa024ae57b600) 00010000:00010000:3.0:1777580314.999173:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580314.999205:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999222:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999234:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999250:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999258:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580314.999264:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.002621:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580315.002798:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002827:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002836:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002843:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.002849:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002857:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002878:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02493bbdf00) 00010000:00010000:2.0:1777580315.002882:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.002888:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.002894:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bdf2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.002949:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946708864 00000100:00100000:2.0:1777580315.002961:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946708864 00000100:00100000:2.0:1777580315.003027:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11998 00000100:00100000:2.0:1777580315.003038:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2361:x1863919946708864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.003080:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.003106:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e962 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.003160:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.003163:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.003173:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 37 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.003193:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 37 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.003208:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1000, rc 0) 00000100:00100000:2.0:1777580315.003276:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2361:x1863919946708864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 240us (15019us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.003285:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11998 00010000:00010000:3.0:1777580315.003508:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.003522:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.003533:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.008791:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946709120 00000100:00100000:2.0:1777580315.008820:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946709120 00000100:00100000:2.0:1777580315.008881:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835947894703 time 7835947794703 state 0x1 ref 2 00000100:00100000:2.0:1777580315.008924:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835947894703 time 7835957785889 state 0x0 ref 2 00000100:00100000:2.0:1777580315.008944:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283291:x1863919946709120:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580315.009032:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580315.009071:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4bd9e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e946 expref: 407 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009123:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4bc63 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8d6 expref: 406 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009157:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:2.0:1777580315.009170:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.009201:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009220:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009232:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009247:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009254:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.009260:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.011312:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.011337:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.011351:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580315.011755:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1885, 64 off128832 00010000:00010000:3.0:1777580315.011877:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011895:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011905:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011913:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011920:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011926:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011950:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580315.011978:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011984:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011990:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.011997:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.012002:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012010:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012033:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:3.0:1777580315.012036:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580315.012042:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012049:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be38 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x822:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012072:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012079:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012085:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012091:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.012093:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012099:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012107:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.012109:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.012113:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.012118:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be23 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.012163:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cf5ae1ed reply state 00000000038f4e08 transno 8589950855 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.012172:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.012289:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283237:x1863919946708736:12345-192.168.202.9@tcp:36:rm.500 Request processed in 13340us (24069us total) trans 8589950855 rc 0/0 00000100:00100000:3.0:1777580315.012301:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19656 00000040:00080000:2.0:1777580315.015310:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1879, 64 off128448 00010000:00010000:2.0:1777580315.017602:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017639:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017656:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017667:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017673:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017680:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017715:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580315.017758:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017765:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017772:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017778:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.017783:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017818:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017834:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa024aee2d100) 00010000:00010000:2.0:1777580315.017837:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580315.017843:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017849:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4be4d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017880:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017886:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017892:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017896:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.017899:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017905:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017912:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.017914:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.017917:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.017933:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4be3f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.017944:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000082c659b3 reply state 000000001981fa90 transno 8589950856 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.017953:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.018075:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283291:x1863919946709120:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9134us (15460us total) trans 8589950856 rc 0/0 00000100:00100000:2.0:1777580315.018087:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19657 00000100:00100000:2.0:1777580315.018098:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835947894703 time 7835957785889 state 0x2 ref 0 00010000:00010000:2.0:1777580315.018289:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580315.018297:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018305:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.018309:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018316:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018326:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x822:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:2.0:1777580315.018329:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.018333:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018338:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x822:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018368:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.018372:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018377:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.018380:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018387:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.018395:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fb:0x0].0x0 (ffffa024aee2d100) 00010000:00010000:3.0:1777580315.020859:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.023555:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.023572:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.023585:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4be5b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.023618:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.023620:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.023623:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580315.060715:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.060833:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580315.060872:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060888:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060897:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060920:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.060926:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060935:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060959:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02493bbd200) 00010000:00010000:2.0:1777580315.060963:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.060970:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.060977:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4be2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061022:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061030:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061036:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061041:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.061044:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061050:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061069:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024aee2da00) 00010000:00010000:2.0:1777580315.061072:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.061076:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.061082:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4be46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.061121:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946709376 00000100:00100000:2.0:1777580315.061151:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946709376 00000100:00100000:2.0:1777580315.061209:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835947894703 time 7835957785889 state 0x0 ref 1 00000100:00100000:2.0:1777580315.061223:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835957885889 time 7835957785889 state 0x1 ref 1 00000100:00100000:2.0:1777580315.061241:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946709504 00000100:00100000:2.0:1777580315.061244:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946709504 00000100:00100000:2.0:1777580315.061256:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835957885889 time 7835957785889 state 0x1 ref 2 00000100:00100000:2.0:1777580315.061275:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836010237789 time 7836010137789 state 0x1 ref 2 00000100:00100000:2.0:1777580315.061287:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283227:x1863919946709376:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580315.061367:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580315.061388:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4b9a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e804 expref: 149 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062534:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4b7a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x820:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e778 expref: 148 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062574:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580315.062587:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.062622:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062638:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062649:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062665:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062673:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062679:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062854:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062863:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.062870:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.064453:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836010237789 time 7836013307110 state 0x0 ref 2 00000100:00100000:3.0:1777580315.064490:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283299:x1863919946709504:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.064524:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.064548:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e969 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064645:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064661:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064671:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064687:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064694:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064713:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064848:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064857:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064865:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580315.064902:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7fd:0x0]: returning size 0 00000004:00200000:3.0:1777580315.064907:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580315.064932:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064947:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064957:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064965:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064972:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064979:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.064983:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.064999:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065013:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.065016:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.065023:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065030:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4be7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065045:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065051:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065057:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065062:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.065065:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065071:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065078:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02493bbd000) 00010000:00010000:3.0:1777580315.065081:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.065084:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065096:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4be85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065175:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4be77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e969 expref: 408 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065191:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e969 expref: 407 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.065199:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580315.065201:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.065204:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f800, rc 0) 00000100:00100000:3.0:1777580315.065294:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283299:x1863919946709504:12345-192.168.202.9@tcp:101:rm.500 Request processed in 821us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.065304:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19659 00000100:00080000:3.0:1777580315.065345:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1777580315.068746:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1886, 64 off128896 00010000:00010000:2.0:1777580315.068901:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.068939:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.068955:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.068965:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.068972:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.068977:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069004:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580315.069035:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069041:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069047:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069053:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.069058:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069065:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069091:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa024aee2d500) 00010000:00010000:2.0:1777580315.069094:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580315.069099:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069105:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4be70 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069128:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069155:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069160:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069165:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.069167:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069173:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069181:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.069183:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.069186:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.069191:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4be62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.069212:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000029f01b96 reply state 00000000d27cffe0 transno 8589950857 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.069222:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.069342:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283227:x1863919946709376:12345-192.168.202.9@tcp:36:rm.500 Request processed in 8050us (8634us total) trans 8589950857 rc 0/0 00000100:00100000:2.0:1777580315.069353:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19658 00000100:00100000:2.0:1777580315.069362:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836010237789 time 7836013307110 state 0x2 ref 0 00010000:00010000:3.0:1777580315.070186:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.070201:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.070212:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.070217:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.070229:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.070246:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x820:0x0].0x0 (ffffa024aee2d500) 00010000:00010000:3.0:1777580315.070265:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.070272:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.070278:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4be93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.070302:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.070303:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.070305:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.088593:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088616:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088625:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088632:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.088639:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088648:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088670:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024aee2d700) 00010000:00010000:3.0:1777580315.088673:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.088678:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.088685:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4be69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.095795:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.095846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.095941:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.095980:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946709632 00000100:00100000:3.0:1777580315.095993:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946709632 00000100:00100000:3.0:1777580315.096040:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836010237789 time 7836013307110 state 0x0 ref 1 00000100:00100000:3.0:1777580315.096056:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836013407110 time 7836013307110 state 0x1 ref 1 00000100:00100000:3.0:1777580315.096083:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946710016 00000100:00100000:3.0:1777580315.096086:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946710016 00000100:00100000:3.0:1777580315.096097:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836013407110 time 7836013307110 state 0x1 ref 2 00000100:00100000:3.0:1777580315.096114:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836045077382 time 7836044977382 state 0x1 ref 2 00000100:00100000:3.0:1777580315.096126:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283213:x1863919946709632:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.096175:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.096201:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4be9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e970 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096288:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096307:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096322:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096364:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096372:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.096379:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098161:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098186:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098201:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580315.098251:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x81d:0x0]: returning size 0 00000004:00200000:3.0:1777580315.098257:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580315.098287:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098301:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098312:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098320:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098349:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098355:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.098360:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098369:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.098384:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.098387:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.098395:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.099976:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836045077382 time 7836048825952 state 0x0 ref 2 00000100:00100000:2.0:1777580315.100021:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283294:x1863919946710016:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580315.100107:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580315.100156:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4be1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e95b expref: 407 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100179:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bcda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e907 expref: 406 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100190:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:2.0:1777580315.100195:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.100224:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100241:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100252:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100284:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100294:0:191688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100302:0:191688:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100324:0:191688:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.100337:0:191688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102547:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bea1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102585:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102593:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102603:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102611:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.102616:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102640:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102659:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02493bbd000) 00010000:00010000:3.0:1777580315.102663:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.102669:0:188495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102680:0:188495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102690:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102743:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.102751:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bea8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.105676:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946709760 00000100:00100000:1.0:1777580315.105696:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946709760 00000100:00100000:1.0:1777580315.105829:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11999 00000100:00100000:1.0:1777580315.105842:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2362:x1863919946709760:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580315.105866:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.105895:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e977 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580315.105934:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15bf:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:1.0:1777580315.105960:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580315.105963:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580315.105975:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 38 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.105998:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 38 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.106035:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7000, rc 0) 00000100:00100000:1.0:1777580315.106125:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2362:x1863919946709760:12345-192.168.202.9@tcp:101:rm.500 Request processed in 286us (10278us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580315.106156:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11999 00010000:00010000:2.0:1777580315.107573:0:191688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107591:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107786:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107816:0:191688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 150 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107827:0:191688:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107883:0:191688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 150 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.107915:0:191688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 150 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.107935:0:191688:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917478272:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580315.108033:0:191688:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023916233c0 going to sleep for 11 seconds 00010000:00010000:3.0:1777580315.111666:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4be9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 150 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.111713:0:188495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.111725:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.111764:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9c00, rc 0) 00000100:00100000:3.0:1777580315.111864:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283213:x1863919946709632:12345-192.168.202.9@tcp:101:rm.500 Request processed in 15737us (16085us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.111876:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19660 00000100:00100000:3.0:1777580315.131949:0:191688:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917478272:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580315.131980:0:191688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.144442:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.144477:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946710400 00000100:00100000:3.0:1777580315.144486:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946710400 00010000:00010000:3.0:1777580315.144866:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.144907:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4408 00000100:00100000:3.0:1777580315.144917:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:2361:x1863919946710400:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580315.144931:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.144938:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.144952:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.144976:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4beaf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e970 expref: 149 pid: 188495 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.145006:0:187616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580315.145011:0:187616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.145022:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.145029:0:187616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.145052:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580315.145098:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:2361:x1863919946710400:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 183us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.145105:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4408 00010000:00010000:3.0:1777580315.145151:0:191688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.145159:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580315.146050:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1880, 64 off128512 00010000:00010000:3.0:1777580315.146182:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146197:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146207:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146226:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146235:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146241:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146267:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580315.146289:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146295:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146304:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146311:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.146315:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146324:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146335:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580315.146338:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580315.146342:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.146358:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4becb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147648:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147660:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147666:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147672:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.147676:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147682:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147694:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.147697:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.147701:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.147707:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4beb6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.147716:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b6e524dd reply state 00000000596b6aa9 transno 8589950858 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.147725:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.148177:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+407:283294:x1863919946710016:12345-192.168.202.9@tcp:36:rm.500 Request processed in 48173us (52230us total) trans 8589950858 rc 0/0 00000100:00100000:3.0:1777580315.148188:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19661 00000100:00100000:3.0:1777580315.148196:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836045077382 time 7836048825952 state 0x2 ref 0 00010000:00010000:3.0:1777580315.149037:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.149045:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.149053:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.149056:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.149064:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.149077:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580315.149080:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.149083:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.149089:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bed2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.149104:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.149105:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.149107:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580315.153939:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580315.154114:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154129:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154161:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154169:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.154176:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154187:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154233:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02493bbd000) 00010000:00010000:0.0:1777580315.154238:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.154246:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.154255:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bebd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.154620:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946710272 00000100:00100000:3.0:1777580315.154634:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946710272 00000100:00100000:3.0:1777580315.154672:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836045077382 time 7836048825952 state 0x0 ref 1 00000100:00100000:3.0:1777580315.154688:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836048925952 time 7836048825952 state 0x1 ref 1 00000100:00100000:3.0:1777580315.154733:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836048925952 time 7836103595710 state 0x0 ref 1 00000100:00100000:3.0:1777580315.154751:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283213:x1863919946710272:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580315.154889:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.154916:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4b690 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e72b expref: 148 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.154936:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x81d:0x0].0x0 (ffffa0248e788100) 00010000:00010000:3.0:1777580315.154947:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.154971:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.154986:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.154996:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155010:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155017:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155023:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155096:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155111:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155117:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155122:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.155125:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155154:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155163:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.155165:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.155169:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155174:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bed9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155186:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155193:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155197:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155201:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.155210:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155216:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155222:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02493bbdc00) 00010000:00010000:3.0:1777580315.155224:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.155226:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.155231:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bee0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.155307:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:283213:x1863919946710272:12345-192.168.202.9@tcp:36:rm.500 Request processed in 563us (1383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777580315.155315:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19662 00000100:00100000:3.0:1777580315.155319:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836048925952 time 7836103595710 state 0x2 ref 0 00000100:00100000:0.0:1777580315.167116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.167790:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946710656 00000100:00100000:1.0:1777580315.167820:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946710656 00000100:00100000:1.0:1777580315.167873:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835808452471 time 7835809332364 state 0x0 ref 1 00000100:00100000:1.0:1777580315.167888:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809432364 time 7835809332364 state 0x1 ref 1 00000100:00100000:1.0:1777580315.167926:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809432364 time 7836116788290 state 0x0 ref 1 00000100:00100000:1.0:1777580315.167943:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+406:283300:x1863919946710656:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.167974:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.168002:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4bee7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e97e expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168273:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168293:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168307:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168325:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168348:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168356:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168449:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4befc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168460:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4befc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.168468:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4befc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580315.168481:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x825:0x0]: returning size 0 00010000:00010000:1.0:1777580315.169829:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169849:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169858:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169865:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.169871:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169881:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169918:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580315.169921:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.169927:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169935:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4beee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169954:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169960:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169967:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169973:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.169976:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169983:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.169991:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0241785fd00) 00010000:00010000:1.0:1777580315.169994:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.169996:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.170001:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bef5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.170093:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4bee7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e97e expref: 409 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.170114:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4befc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e97e expref: 408 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.170122:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:1.0:1777580315.170125:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580315.170129:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839e00, rc 0) 00000100:00100000:1.0:1777580315.170271:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+408:283300:x1863919946710656:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2331us (3161us total) trans 8589950859 rc 0/0 00000100:00100000:1.0:1777580315.170285:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19663 00000100:00100000:1.0:1777580315.170295:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809432364 time 7836116788290 state 0x2 ref 0 00000100:00100000:0.0:1777580315.205595:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.206602:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.206697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.206766:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946710912 00000100:00100000:2.0:1777580315.206783:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946710912 00000100:00100000:2.0:1777580315.206854:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836048925952 time 7836103595710 state 0x0 ref 1 00000100:00100000:2.0:1777580315.206873:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836103695710 time 7836103595710 state 0x1 ref 1 00000100:00100000:2.0:1777580315.206910:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946711168 00000100:00100000:2.0:1777580315.206913:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946711168 00000100:00100000:2.0:1777580315.206927:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7835809432364 time 7836116788290 state 0x0 ref 1 00000100:00100000:2.0:1777580315.206934:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836116888290 time 7836116788290 state 0x1 ref 1 00000100:00100000:2.0:1777580315.206952:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946711424 00000100:00100000:2.0:1777580315.206956:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946711424 00000100:00100000:2.0:1777580315.206971:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836116888290 time 7836116788290 state 0x1 ref 2 00000100:00100000:2.0:1777580315.207001:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836103695710 time 7836155862099 state 0x0 ref 1 00000100:00100000:2.0:1777580315.207018:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:283233:x1863919946710912:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:0.0:1777580315.207028:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155983772 time 7836155883772 state 0x1 ref 2 00000100:00100000:0.0:1777580315.207056:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+409:283300:x1863919946711168:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580315.207106:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580315.207122:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580315.207178:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4b9df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x821:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e80b expref: 147 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207200:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4befc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e97e expref: 409 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207264:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580315.207276:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4b7bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x821:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e786 expref: 146 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207281:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.207295:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024ae57bd00) 00010000:00010000:2.0:1777580315.207310:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.207343:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207363:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207366:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207382:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207402:0:191688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207413:0:191688:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207417:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207428:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207464:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207494:0:191688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207512:0:191688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 145 pid: 187632 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.207532:0:191688:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917478400:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580315.207620:0:191688:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02392bc9480 going to sleep for 11 seconds 00000100:00100000:0.0:1777580315.207648:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155983772 time 7836156510297 state 0x0 ref 2 00010000:00010000:2.0:1777580315.207652:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.207665:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.207667:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+408:283301:x1863919946711424:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580315.207688:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207688:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.207702:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4bf26 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e985 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207863:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207875:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207887:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207907:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207915:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.207931:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580315.208554:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1881, 64 off128576 00010000:00010000:2.0:1777580315.208667:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208681:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580315.208689:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c0:0x0], index 1: 0 00010000:00010000:2.0:1777580315.208692:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208703:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208710:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208717:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208744:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580315.208773:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208778:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208785:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208791:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.208797:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208833:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208849:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024aee2d100) 00010000:00010000:2.0:1777580315.208854:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580315.208859:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208866:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf1f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x821:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208887:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208895:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208903:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208908:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.208910:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208916:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208926:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.208926:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bf42 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208931:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.208936:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.208953:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf0a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.208963:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000037288ae6 reply state 0000000070225419 transno 8589950860 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.208973:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.209064:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:283233:x1863919946710912:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2049us (3476us total) trans 8589950860 rc 0/0 00000100:00100000:2.0:1777580315.209074:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19664 00000100:00100000:2.0:1777580315.209083:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836103695710 time 7836155862099 state 0x2 ref 0 00010000:00010000:0.0:1777580315.209174:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bf42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209185:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bf42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209252:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209271:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209278:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209300:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.209305:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209313:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209349:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.209353:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.209385:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209393:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4bf2d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.209449:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000044b2ede7 reply state 00000000eca4a639 transno 8589950861 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.209458:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580315.209521:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4bf26 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e985 expref: 411 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209567:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bf42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e985 expref: 410 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.209575:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa0248a60e300) 00010000:00010000:0.0:1777580315.209577:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.209579:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:0.0:1777580315.209742:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+411:283301:x1863919946711424:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2052us (3015us total) trans 8589950861 rc 0/0 00000100:00100000:0.0:1777580315.209753:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19666 00010000:00010000:3.0:1777580315.212677:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.212690:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.213272:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.213276:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.213285:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.213302:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x821:0x0].0x0 (ffffa024aee2d100) 00010000:00010000:3.0:1777580315.213322:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.213327:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.213333:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4bf3b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x821:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.213357:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.213359:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.213361:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580315.224585:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.224619:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224632:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224640:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224646:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.224651:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224658:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224674:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0248a60ee00) 00010000:00010000:3.0:1777580315.224677:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.224682:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.224709:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4bf34 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.224787:0:191688:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:191688:1863919917478400:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580315.224829:0:191688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.224857:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946711680 00000100:00100000:3.0:1777580315.224863:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946711680 00000100:00100000:3.0:1777580315.224896:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836103695710 time 7836155862099 state 0x0 ref 1 00000100:00100000:3.0:1777580315.224906:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155962099 time 7836155862099 state 0x1 ref 1 00000100:00100000:3.0:1777580315.224929:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155962099 time 7836173792134 state 0x0 ref 1 00000100:00100000:3.0:1777580315.224940:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:283240:x1863919946711680:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580315.224995:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580315.225011:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4b984 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x823:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7fd expref: 147 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225026:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4b849 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x823:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7b7 expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225035:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02483f8e600) 00010000:00010000:3.0:1777580315.225043:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.225064:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225086:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225094:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225107:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225114:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225119:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225339:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225347:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225354:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225796:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580315.225821:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1882, 64 off128640 00010000:00010000:2.0:1777580315.225825:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225835:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225841:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.225847:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225855:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225875:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024aee2da00) 00010000:00010000:2.0:1777580315.225878:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.225898:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225900:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.225929:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bf18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225934:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225956:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225971:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225978:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.225984:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227289:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580315.227321:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227330:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227336:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227342:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.227346:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227352:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227362:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:3.0:1777580315.227365:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580315.227368:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227390:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4bf5e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x823:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227413:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227418:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227424:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227428:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.227431:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227437:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227445:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.227448:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.227451:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.227456:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4bf50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.227464:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000079f40226 reply state 0000000018a5eb1c transno 8589950862 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.227472:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.227567:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283240:x1863919946711680:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2625us (2989us total) trans 8589950862 rc 0/0 00000100:00100000:3.0:1777580315.227576:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19667 00000100:00100000:3.0:1777580315.227583:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155962099 time 7836173792134 state 0x2 ref 0 00010000:00010000:2.0:1777580315.238586:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.238604:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.238630:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.238635:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.238645:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.238668:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x823:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:2.0:1777580315.238671:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.238677:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.238683:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4bf65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x823:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.238720:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.238722:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.238724:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580315.244700:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.244839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.244877:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712320 00000100:00100000:3.0:1777580315.244886:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712320 00000100:00100000:3.0:1777580315.244930:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836156610297 time 7836156510297 state 0x1 ref 2 00000100:00100000:3.0:1777580315.244959:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836156610297 time 7836193821024 state 0x0 ref 2 00000100:00100000:3.0:1777580315.244970:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+410:283301:x1863919946712320:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.245026:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.245054:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bf42 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e985 expref: 410 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.245075:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa0248a60e300) 00010000:00010000:3.0:1777580315.245085:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.245175:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.245202:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.245212:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.245347:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f8d4952d reply state 000000004c3715c2 transno 8589950863 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.245368:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.245447:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+411:283301:x1863919946712320:12345-192.168.202.9@tcp:36:touch.500 Request processed in 477us (607us total) trans 8589950863 rc 0/0 00000100:00100000:3.0:1777580315.245454:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19668 00000100:00100000:2.0:1777580315.246644:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946711808 00000100:00100000:2.0:1777580315.246660:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946711808 00010000:00010000:2.0:1777580315.246715:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 146 pid: 187632 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.246795:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4409 00000100:00100000:2.0:1777580315.246816:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:2364:x1863919946711808:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580315.246837:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580315.246845:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 146 pid: 187632 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246859:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 146 pid: 187632 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246882:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4bd19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f2 expref: 146 pid: 187632 timeout: 7936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246903:0:190365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580315.246910:0:190365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246921:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246930:0:190365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.246969:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.246995:0:191688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.247008:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.247039:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:2364:x1863919946711808:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 234us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.247049:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4409 00010000:00010000:2.0:1777580315.247091:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247109:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247118:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247125:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00000004:00010000:3.0:1777580315.247129:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000081b505ca reply state 00000000673ffbc2 transno 8589950864 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247131:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247190:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247203:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580315.247207:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.247211:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.247217:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4bf57 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.247271:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.247448:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+412:283300:x1863919946711168:12345-192.168.202.9@tcp:36:touch.500 Request processed in 40401us (40846us total) trans 8589950864 rc 0/0 00000100:00100000:3.0:1777580315.247456:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19665 00000100:00100000:3.0:1777580315.247463:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836156610297 time 7836193821024 state 0x2 ref 0 00010000:00010000:3.0:1777580315.252587:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580315.255764:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.255850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.255983:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.256108:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580315.256199:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256214:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256245:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256254:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.256261:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256271:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256295:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580315.256299:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.256305:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.256313:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4bf11 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.258127:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712192 00000100:00100000:3.0:1777580315.258155:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712192 00000100:00100000:3.0:1777580315.258267:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836156610297 time 7836193821024 state 0x0 ref 1 00000100:00100000:3.0:1777580315.258280:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836193921024 time 7836193821024 state 0x1 ref 1 00000100:00100000:3.0:1777580315.258310:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712576 00000100:00100000:3.0:1777580315.258314:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712576 00000100:00100000:3.0:1777580315.258326:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836155962099 time 7836173792134 state 0x0 ref 1 00000100:00100000:3.0:1777580315.258345:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836173892134 time 7836173792134 state 0x1 ref 1 00000100:00100000:3.0:1777580315.258365:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712704 00000100:00100000:3.0:1777580315.258368:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712704 00000100:00100000:3.0:1777580315.258453:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836193921024 time 7836193821024 state 0x1 ref 2 00000100:00100000:3.0:1777580315.258470:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712832 00000100:00100000:3.0:1777580315.258473:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712832 00000100:00100000:3.0:1777580315.258487:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836193921024 time 7836193821024 state 0x1 ref 3 00000100:00100000:3.0:1777580315.258503:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836173892134 time 7836207365583 state 0x0 ref 1 00000100:00100000:3.0:1777580315.258519:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283265:x1863919946712576:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580315.258578:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580315.258605:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4baa3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x826:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e874 expref: 144 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.258627:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4ba10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x826:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e819 expref: 143 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.258720:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa02499549300) 00010000:00010000:3.0:1777580315.258732:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.258765:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.258824:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836207779358 time 7836207679358 state 0x1 ref 3 00000100:00100000:2.0:1777580315.258855:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+413:283305:x1863919946712192:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.258876:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.258877:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.258892:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.258900:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e98c expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.258933:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.258943:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.258950:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259074:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259091:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259103:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259164:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259166:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259210:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259219:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.259227:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259293:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.259560:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208521763 time 7836208421763 state 0x1 ref 3 00000100:00100000:3.0:1777580315.259578:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+414:283300:x1863919946712704:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.259592:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.259604:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bf9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e993 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259653:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bf9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e993 expref: 415 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259665:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9c00/0xcb2b2f2f7e4bf9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e993 expref: 415 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259690:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:3.0:1777580315.259693:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580315.259696:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9c00, rc 0) 00000100:00100000:3.0:1777580315.259767:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+415:283300:x1863919946712704:12345-192.168.202.9@tcp:101:touch.500 Request processed in 194us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.259787:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19671 00000100:00100000:3.0:1777580315.259834:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208521763 time 7836208697054 state 0x0 ref 2 00000100:00100000:3.0:1777580315.259847:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+414:283301:x1863919946712832:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.259856:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.259950:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bfa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e99a expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259981:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e99a expref: 415 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.259991:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e99a expref: 415 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260003:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:3.0:1777580315.260005:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580315.260008:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8200, rc 0) 00000100:00100000:3.0:1777580315.260027:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+415:283301:x1863919946712832:12345-192.168.202.9@tcp:101:touch.500 Request processed in 184us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.260033:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19672 00010000:00010000:3.0:1777580315.260069:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260078:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260085:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260091:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.260096:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260104:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260114:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:3.0:1777580315.260117:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.260120:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.260126:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4bf6c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580315.263596:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1887, 64 off128960 00000004:00080000:1.0:1777580315.263613:0:188495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7836212477626ns, next at 7837212472297ns, rc = 0 00010000:00010000:1.0:1777580315.263770:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263795:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263827:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263840:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263864:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263872:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263909:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580315.263945:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263952:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263960:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263969:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.263975:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.263984:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264005:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:1.0:1777580315.264009:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580315.264017:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264024:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4bf8f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x826:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264068:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264076:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264083:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264091:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.264095:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264103:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264116:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580315.264119:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.264123:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.264130:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4bf73 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580315.264192:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009c6262fe reply state 00000000a9f26f8a transno 8589950865 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.264203:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580315.264335:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283265:x1863919946712576:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5813us (8481us total) trans 8589950865 rc 0/0 00000100:00100000:1.0:1777580315.264352:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19670 00000100:00100000:1.0:1777580315.264369:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836173892134 time 7836207365583 state 0x2 ref 0 00010000:00010000:3.0:1777580315.264675:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.264688:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.264700:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.264705:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.264715:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.264750:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x826:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:3.0:1777580315.264754:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.264758:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.264765:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4bfab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x826:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.264794:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.264796:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.264798:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1777580315.266771:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e5:0x0], index 0: 0 00010000:00010000:2.0:1777580315.267164:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bfb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267185:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267200:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267244:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267252:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267260:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267267:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.267286:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267294:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267310:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.267314:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.267318:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.267325:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4bf88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.267341:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000085ca6106 reply state 00000000f5b4cf6f transno 8589950866 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.267351:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580315.272653:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4bf7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e98c expref: 415 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.272721:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bfb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e98c expref: 414 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.272735:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580315.272739:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580315.272746:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997e600, rc 0) 00000100:00100000:2.0:1777580315.272889:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+415:283305:x1863919946712192:12345-192.168.202.9@tcp:101:touch.500 Request processed in 14043us (17140us total) trans 8589950866 rc 0/0 00000100:00100000:2.0:1777580315.272906:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19669 00000100:00100000:2.0:1777580315.272932:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208521763 time 7836208697054 state 0x2 ref 0 00010000:00010000:3.0:1777580315.276891:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276908:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276916:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276922:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.276926:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276933:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276950:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02493bbdb00) 00010000:00010000:3.0:1777580315.276952:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.276958:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.276977:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4bf81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285101:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285118:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285126:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285146:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.285151:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285159:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285177:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024aee2d600) 00010000:00010000:2.0:1777580315.285180:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.285185:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.285191:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4bf96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.310331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.310554:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.326315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.330888:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946713216 00000100:00100000:0.0:1777580315.330907:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946713216 00000100:00100000:0.0:1777580315.330972:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836173892134 time 7836207365583 state 0x0 ref 1 00000100:00100000:0.0:1777580315.330988:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836207465583 time 7836207365583 state 0x1 ref 1 00000100:00100000:0.0:1777580315.331039:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946713600 00000100:00100000:0.0:1777580315.331042:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946713600 00000100:00100000:0.0:1777580315.331072:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208521763 time 7836208697054 state 0x0 ref 1 00000100:00100000:0.0:1777580315.331080:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208797054 time 7836208697054 state 0x1 ref 1 00000100:00100000:0.0:1777580315.331099:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836207465583 time 7836279961018 state 0x0 ref 1 00000100:00100000:0.0:1777580315.331116:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283246:x1863919946713216:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580315.331207:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580315.331241:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4bc94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x824:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8e4 expref: 143 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331267:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4b87a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x824:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7c5 expref: 142 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331280:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:0.0:1777580315.331307:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.331339:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331356:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331368:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331494:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331504:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331521:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331676:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331685:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.331692:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.332549:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946713728 00000100:00100000:3.0:1777580315.332565:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946713728 00000100:00100000:3.0:1777580315.332626:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208797054 time 7836281482981 state 0x0 ref 1 00000100:00100000:3.0:1777580315.332673:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+415:283305:x1863919946713600:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.332743:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.332793:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4bfb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e98c expref: 415 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.332836:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:3.0:1777580315.332861:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.332944:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.332960:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.332975:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.333200:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007479dd1 reply state 00000000caab0262 transno 8589950867 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.333211:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.333342:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+416:283305:x1863919946713600:12345-192.168.202.9@tcp:36:touch.500 Request processed in 689us (22788us total) trans 8589950867 rc 0/0 00000100:00100000:3.0:1777580315.333370:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19674 00000100:00100000:3.0:1777580315.333377:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208797054 time 7836281482981 state 0x2 ref 0 00000040:00080000:0.0:1777580315.333519:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1888, 64 off129024 00010000:00010000:0.0:1777580315.333624:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333640:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333651:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333661:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333668:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333675:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333700:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580315.333831:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333838:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333845:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333851:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.333855:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333863:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333877:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:0.0:1777580315.333880:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580315.333885:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333892:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4bfce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x824:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333918:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333925:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333932:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333950:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.333953:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333959:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333968:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.333970:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.333973:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.333979:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4bfc0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.333992:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007b86f5df reply state 00000000081f61f9 transno 8589950868 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.334001:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.334083:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283246:x1863919946713216:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2971us (23764us total) trans 8589950868 rc 0/0 00000100:00100000:0.0:1777580315.334094:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19673 00000100:00100000:0.0:1777580315.334102:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836207465583 time 7836279961018 state 0x2 ref 0 00010000:00010000:3.0:1777580315.335040:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.335051:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335062:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.335068:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335078:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335093:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x824:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:3.0:1777580315.335097:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.335100:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335106:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4bfdc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x824:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335127:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.335129:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.335130:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580315.335274:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836208797054 time 7836281482981 state 0x0 ref 1 00000100:00100000:3.0:1777580315.335286:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836281582981 time 7836281482981 state 0x1 ref 1 00000100:00100000:3.0:1777580315.335323:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836281582981 time 7836284185670 state 0x0 ref 1 00000100:00100000:3.0:1777580315.335347:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+415:283306:x1863919946713728:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.335368:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.335385:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bfe3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9a1 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335522:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335536:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335546:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335559:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335566:0:187630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335573:0:187630:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335590:0:187630:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.335598:0:187630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.343623:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.343652:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.343737:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343877:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343886:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343891:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.343896:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343905:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343922:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:3.0:1777580315.343925:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.343930:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.343937:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4bfd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.344232:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946713856 00000100:00100000:2.0:1777580315.344257:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946713856 00000100:00100000:2.0:1777580315.344320:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946712960 00000100:00100000:2.0:1777580315.344323:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946712960 00000100:00100000:2.0:1777580315.344349:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12000 00000100:00100000:2.0:1777580315.344360:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2362:x1863919946713856:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580315.344816:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2362:x1863919946713856:12345-192.168.202.9@tcp:2:touch.500 Request processed in 446us (1197us total) trans 8589938627 rc 0/0 00000100:00100000:2.0:1777580315.344826:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12000 00000100:00100000:2.0:1777580315.344845:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12001 00000100:00100000:2.0:1777580315.344852:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2364:x1863919946712960:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:2.0:1777580315.344941:0:205898:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x15ba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777580315.344946:0:205898:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x15ba:0x0] updating lvb mtime from disk: 1777580313 -> 1777580314 00002000:00010000:2.0:1777580315.344949:0:205898:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x15ba:0x0] updating lvb atime from disk: 1777580313 -> 1777580314 00002000:00010000:2.0:1777580315.344951:0:205898:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x15ba:0x0] updating lvb ctime from disk: 1777580313 -> 1777580314 00002000:00010000:2.0:1777580315.344954:0:205898:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x15ba:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1777580315.344975:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2364:x1863919946712960:12345-192.168.202.9@tcp:2:touch.500 Request processed in 123us (1321us total) trans 8589938628 rc 0/0 00000100:00100000:2.0:1777580315.344981:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12001 00010000:00010000:2.0:1777580315.356789:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356824:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356834:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356841:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.356861:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356870:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356894:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0248a60ef00) 00010000:00010000:2.0:1777580315.356898:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.356904:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356917:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356927:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356976:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.356984:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4bfc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.356999:0:187630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.357017:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.361232:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:3.0:1777580315.363480:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c1:0x0], index 1: 0 00010000:00010000:3.0:1777580315.363721:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4bff8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.363763:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365277:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365358:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365368:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365374:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365463:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.365469:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365477:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365492:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.365495:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.365503:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365510:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4bfea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.365531:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000687f9769 reply state 0000000092dec4b4 transno 8589950869 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.365545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.365563:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.365592:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.365622:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4bfe3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a1 expref: 417 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365642:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4bff8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a1 expref: 416 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.365650:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:3.0:1777580315.365652:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.365655:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:2.0:1777580315.365758:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946714368 00000100:00100000:3.0:1777580315.365767:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+417:283306:x1863919946713728:12345-192.168.202.9@tcp:101:touch.500 Request processed in 30418us (39474us total) trans 8589950869 rc 0/0 00000100:00100000:2.0:1777580315.365774:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946714368 00000100:00100000:3.0:1777580315.365795:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19675 00000100:00100000:3.0:1777580315.365811:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836281582981 time 7836284185670 state 0x2 ref 0 00000100:00100000:3.0:1777580315.365860:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946714112 00000100:00100000:3.0:1777580315.365871:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946714112 00000100:00100000:2.0:1777580315.365875:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4213 00000100:00100000:2.0:1777580315.365897:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+417:283300:x1863919946714368:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580315.365914:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836207465583 time 7836279961018 state 0x0 ref 1 00000100:00100000:3.0:1777580315.365926:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836280061018 time 7836279961018 state 0x1 ref 1 00000100:00100000:3.0:1777580315.365947:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946714496 00000100:00100000:3.0:1777580315.365952:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946714496 00000100:00100000:3.0:1777580315.365966:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836281582981 time 7836284185670 state 0x0 ref 1 00000100:00100000:3.0:1777580315.365973:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836284285670 time 7836284185670 state 0x1 ref 1 00000100:00100000:3.0:1777580315.365993:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836280061018 time 7836314855016 state 0x0 ref 1 00000100:00100000:3.0:1777580315.366017:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283264:x1863919946714112:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580315.366073:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580315.366101:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4bcb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x827:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8eb expref: 142 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366122:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4ba09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x827:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e827 expref: 141 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366167:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:3.0:1777580315.366178:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.366202:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366216:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366227:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.366235:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283300:x1863919946714368:12345-192.168.202.9@tcp:35:touch.500 Request processed in 347us (698us total) trans 8589950870 rc 0/0 00010000:00010000:3.0:1777580315.366248:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366274:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.366277:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4213 00010000:00010000:3.0:1777580315.366290:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.366327:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836284285670 time 7836315185903 state 0x0 ref 1 00000100:00100000:2.0:1777580315.366342:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:283305:x1863919946714496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580315.366361:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.366385:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c014 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9a8 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366447:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.366448:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c014 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x800:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a8 expref: 419 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.366472:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c014 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x800:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a8 expref: 419 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366474:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.366510:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.366520:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:2.0:1777580315.366525:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580315.366528:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997f600, rc 0) 00000100:00100000:2.0:1777580315.366556:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283305:x1863919946714496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 216us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.366563:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19677 00000100:00100000:2.0:1777580315.366569:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836284285670 time 7836315185903 state 0x2 ref 0 00000040:00080000:3.0:1777580315.367104:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1883, 64 off128704 00010000:00010000:3.0:1777580315.367219:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367230:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367239:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367248:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367254:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367261:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367285:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580315.367304:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367310:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367329:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367335:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.367338:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367346:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367355:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:3.0:1777580315.367358:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580315.367361:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367367:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4c01b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x827:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367385:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367391:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367397:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367401:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.367403:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367419:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367426:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.367428:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.367431:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.367435:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c006 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.367444:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000022a74a15 reply state 000000000c3346ae transno 8589950871 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.367451:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.367515:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283264:x1863919946714112:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1501us (6296us total) trans 8589950871 rc 0/0 00000100:00100000:3.0:1777580315.367523:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19676 00000100:00100000:3.0:1777580315.367529:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836280061018 time 7836314855016 state 0x2 ref 0 00010000:00010000:2.0:1777580315.372127:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.372171:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.372187:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.372223:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.372235:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.372260:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x827:0x0].0x0 (ffffa02493bbd800) 00010000:00010000:2.0:1777580315.372264:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.372271:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.372279:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4c022 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x827:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.372314:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.372316:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.372318:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580315.377871:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.377982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.378006:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.378107:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580315.378168:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378201:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378210:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378217:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.378223:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378231:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378251:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02493bbdc00) 00010000:00010000:0.0:1777580315.378254:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.378260:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378267:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c00d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.378329:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946715136 00000100:00100000:0.0:1777580315.378342:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946715136 00000100:00100000:0.0:1777580315.378388:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836284285670 time 7836315185903 state 0x0 ref 1 00000100:00100000:0.0:1777580315.378405:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836315285903 time 7836315185903 state 0x1 ref 1 00000100:00100000:0.0:1777580315.378426:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946715392 00000100:00100000:0.0:1777580315.378429:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946715392 00000100:00100000:0.0:1777580315.378440:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836280061018 time 7836314855016 state 0x0 ref 1 00000100:00100000:0.0:1777580315.378455:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836314955016 time 7836314855016 state 0x1 ref 1 00000100:00100000:0.0:1777580315.378480:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836314955016 time 7836327341573 state 0x0 ref 1 00000100:00100000:0.0:1777580315.378492:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+420:283299:x1863919946715392:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580315.378578:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580315.378600:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4be8c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e969 expref: 420 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378617:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4bd27 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e92a expref: 419 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378626:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa024989ec600) 00010000:00010000:0.0:1777580315.378633:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.378663:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378679:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378690:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378707:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378714:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378720:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378918:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378926:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.378933:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379565:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379584:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580315.379587:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1884, 64 off128768 00010000:00010000:3.0:1777580315.379600:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379607:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.379634:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379643:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379664:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0248a60ef00) 00010000:00010000:3.0:1777580315.379668:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.379675:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.379682:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4bff1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379691:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379704:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379716:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379725:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379732:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.379735:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946714880 00010000:00010000:0.0:1777580315.379739:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.379751:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946714880 00010000:00010000:0.0:1777580315.379771:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580315.379799:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379842:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.379851:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12002 00010000:00010000:0.0:1777580315.379857:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379866:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.379872:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.379873:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946714880:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580315.379892:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379904:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa0248a60eb00) 00010000:00010000:0.0:1777580315.379907:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580315.379911:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379918:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c037 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379942:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379950:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379956:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379961:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.379972:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379978:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.379989:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.379993:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.379997:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.380004:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c029 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.380018:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005004106d reply state 000000000054efa5 transno 8589950872 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.380029:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.380178:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283299:x1863919946715392:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1685us (2067us total) trans 8589950872 rc 0/0 00000100:00100000:0.0:1777580315.380188:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19679 00000100:00100000:0.0:1777580315.380196:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836314955016 time 7836327341573 state 0x2 ref 0 00000100:00100000:0.0:1777580315.380234:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836315285903 time 7836329096431 state 0x0 ref 1 00000100:00100000:0.0:1777580315.380248:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:283306:x1863919946715136:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580315.380293:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580315.380311:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4bff8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a1 expref: 418 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.380334:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:0.0:1777580315.380344:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.380411:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.380420:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.380428:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.380532:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007eaaae4b reply state 00000000643b8e0f transno 8589950873 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.380540:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.380593:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283306:x1863919946715136:12345-192.168.202.9@tcp:36:touch.500 Request processed in 349us (2586us total) trans 8589950873 rc 0/0 00000100:00100000:0.0:1777580315.380601:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19678 00000100:00100000:0.0:1777580315.380606:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836315285903 time 7836329096431 state 0x2 ref 0 00000100:00100000:3.0:1777580315.380764:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946714880:12345-192.168.202.9@tcp:2:touch.500 Request processed in 894us (2775us total) trans 8589939028 rc 0/0 00000100:00100000:3.0:1777580315.380777:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12002 00010000:00010000:3.0:1777580315.380859:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.380868:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.380878:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.380885:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.380894:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.380925:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7fd:0x0].0x0 (ffffa0248a60eb00) 00010000:00010000:3.0:1777580315.380929:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.380934:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.380941:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c03e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.380980:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.380984:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.380987:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777580315.381001:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777580315.381940:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946714752 00000100:00100000:2.0:1777580315.381955:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946714752 00000100:00100000:2.0:1777580315.382022:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4214 00000100:00100000:2.0:1777580315.382033:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283301:x1863919946714752:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.382462:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+420:283301:x1863919946714752:12345-192.168.202.9@tcp:35:touch.500 Request processed in 430us (4607us total) trans 8589950874 rc 0/0 00000100:00100000:2.0:1777580315.382472:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4214 00000100:00100000:2.0:1777580315.389233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.390971:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946715520 00000100:00100000:2.0:1777580315.390990:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946715520 00000100:00100000:2.0:1777580315.391053:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836314955016 time 7836327341573 state 0x0 ref 1 00000100:00100000:2.0:1777580315.391069:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836327441573 time 7836327341573 state 0x1 ref 1 00000100:00100000:2.0:1777580315.391126:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836327441573 time 7836339987249 state 0x0 ref 1 00000100:00100000:2.0:1777580315.391161:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283247:x1863919946715520:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.391197:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.391228:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c04c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9af expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391328:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391349:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391364:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391381:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391389:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391396:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391544:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391554:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391573:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580315.391609:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x825:0x0]: returning size 0 00000004:00200000:2.0:1777580315.391614:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580315.391640:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391654:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391664:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391671:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391678:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391685:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.391690:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391699:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391713:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.391716:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.391723:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391740:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c053 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391758:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391763:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391785:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391792:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.391795:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391810:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391819:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024aee2db00) 00010000:00010000:2.0:1777580315.391822:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.391825:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391831:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c05a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391873:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c04c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9af expref: 143 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391903:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9af expref: 142 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.391911:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:2.0:1777580315.391914:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580315.391916:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997ee00, rc 0) 00000100:00100000:2.0:1777580315.392009:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283247:x1863919946715520:12345-192.168.202.9@tcp:101:rm.500 Request processed in 856us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.392018:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19680 00000100:00100000:2.0:1777580315.392025:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836327441573 time 7836339987249 state 0x2 ref 0 00010000:00010000:0.0:1777580315.399949:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.399973:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.399982:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.399988:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.400015:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.400024:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.400045:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0248a60e800) 00010000:00010000:0.0:1777580315.400048:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.400054:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.400060:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c030 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402437:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402457:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402465:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402472:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.402477:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402486:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402504:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:0.0:1777580315.402508:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.402530:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.402536:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c045 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.412010:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.419945:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946715776 00000100:00100000:1.0:1777580315.419964:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946715776 00000100:00100000:1.0:1777580315.420042:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4215 00000100:00100000:1.0:1777580315.420054:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+418:283305:x1863919946715776:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580315.420793:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283305:x1863919946715776:12345-192.168.202.9@tcp:35:touch.500 Request processed in 738us (8795us total) trans 8589950875 rc 0/0 00000100:00100000:1.0:1777580315.420815:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4215 00000100:00100000:2.0:1777580315.421683:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.424546:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946715904 00000100:00100000:3.0:1777580315.424561:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946715904 00000100:00100000:3.0:1777580315.424610:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836315285903 time 7836329096431 state 0x0 ref 1 00000100:00100000:3.0:1777580315.424685:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836329196431 time 7836329096431 state 0x1 ref 1 00000100:00100000:3.0:1777580315.424716:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836329196431 time 7836373578693 state 0x0 ref 1 00000100:00100000:3.0:1777580315.424730:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+419:283306:x1863919946715904:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.424761:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.424786:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c068 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9b6 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.424858:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c068 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x801:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9b6 expref: 420 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.424873:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c068 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x801:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9b6 expref: 420 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.424911:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:3.0:1777580315.424914:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580315.424918:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f148c00, rc 0) 00000100:00100000:3.0:1777580315.424990:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+420:283306:x1863919946715904:12345-192.168.202.9@tcp:101:touch.500 Request processed in 266us (3313us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.424998:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19681 00000100:00100000:3.0:1777580315.425002:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836329196431 time 7836373578693 state 0x2 ref 0 00000100:00100000:3.0:1777580315.426375:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.426606:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.431197:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946716160 00000100:00100000:0.0:1777580315.431218:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946716160 00000100:00100000:0.0:1777580315.431276:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836329196431 time 7836373578693 state 0x0 ref 1 00000100:00100000:0.0:1777580315.431294:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836373678693 time 7836373578693 state 0x1 ref 1 00000100:00100000:0.0:1777580315.431322:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946716416 00000100:00100000:0.0:1777580315.431326:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946716416 00000100:00100000:0.0:1777580315.431340:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836327441573 time 7836339987249 state 0x0 ref 1 00000100:00100000:0.0:1777580315.431347:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836340087249 time 7836339987249 state 0x1 ref 1 00000100:00100000:0.0:1777580315.431377:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836340087249 time 7836380239143 state 0x0 ref 1 00000100:00100000:0.0:1777580315.431405:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283247:x1863919946716416:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:3.0:1777580315.431420:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836373678693 time 7836380269510 state 0x0 ref 1 00000100:00100000:3.0:1777580315.431458:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+420:283308:x1863919946716160:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.431487:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.431495:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580315.431513:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c06f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9bd expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431537:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c061 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x825:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9af expref: 142 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431566:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4400/0xcb2b2f2f7e4b8a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x825:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e7cc expref: 141 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431577:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:0.0:1777580315.431604:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.431629:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431646:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431659:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431677:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431685:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.431691:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431694:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.431736:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.431751:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.431775:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431874:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431885:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.431892:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580315.432584:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1885, 64 off128832 00010000:00010000:0.0:1777580315.432669:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432682:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432699:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432708:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432714:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432721:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432750:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580315.432775:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432782:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432788:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432795:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.432799:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432823:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432834:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:0.0:1777580315.432837:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580315.432849:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432856:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8be00/0xcb2b2f2f7e4c092 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x825:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432881:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432888:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432893:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432898:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.432900:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432906:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432914:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.432916:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.432919:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.432924:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8bc00/0xcb2b2f2f7e4c076 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.432934:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000079d87806 reply state 00000000aaa2e265 transno 8589950876 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.432953:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.433076:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283247:x1863919946716416:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1676us (6466us total) trans 8589950876 rc 0/0 00000100:00100000:0.0:1777580315.433087:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19683 00000100:00100000:0.0:1777580315.433094:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836340087249 time 7836380239143 state 0x2 ref 0 00010000:00010000:0.0:1777580315.433179:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580315.433187:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.433193:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580315.433197:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.433204:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.433213:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x825:0x0].0x0 (ffffa024ad9fdb00) 00010000:00010000:0.0:1777580315.433216:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580315.433219:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.433225:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c099 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x825:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.433237:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580315.433239:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580315.433241:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.436866:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.436892:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580315.438892:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e6:0x0], index 0: 0 00010000:00010000:3.0:1777580315.439946:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c0a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440092:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440108:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440475:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440485:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440492:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440499:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.440503:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440510:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440557:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.440560:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.440565:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440572:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c084 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.440589:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001f5854b6 reply state 00000000acc927b0 transno 8589950877 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.440599:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.440671:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c06f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9bd expref: 423 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440688:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9bd expref: 422 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.440695:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:3.0:1777580315.440792:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.440796:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fa00, rc 0) 00000100:00100000:3.0:1777580315.440907:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:283308:x1863919946716160:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9468us (14536us total) trans 8589950877 rc 0/0 00000100:00100000:3.0:1777580315.440917:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19682 00000100:00100000:3.0:1777580315.440925:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836373678693 time 7836380269510 state 0x2 ref 0 00000100:00100000:2.0:1777580315.469419:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.471075:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.471116:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946716800 00000100:00100000:2.0:1777580315.471126:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946716800 00000100:00100000:2.0:1777580315.471187:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836340087249 time 7836380239143 state 0x0 ref 1 00000100:00100000:2.0:1777580315.471201:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380339143 time 7836380239143 state 0x1 ref 1 00000100:00100000:2.0:1777580315.471227:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380339143 time 7836420089350 state 0x0 ref 1 00000100:00100000:2.0:1777580315.471239:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283268:x1863919946716800:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580315.471300:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580315.471328:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4bcf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x828:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8f9 expref: 142 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471373:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4ba80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x828:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e86d expref: 141 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471382:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:2.0:1777580315.471394:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.471433:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471446:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471455:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471469:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471475:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471481:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471622:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471631:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.471638:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580315.472244:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1886, 64 off128896 00010000:00010000:2.0:1777580315.472309:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472319:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472327:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472334:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472340:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472345:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472365:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580315.472383:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472389:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472394:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472399:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.472404:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472417:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472425:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa024aee2d200) 00010000:00010000:2.0:1777580315.472428:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580315.472431:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472437:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c0bc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x828:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472453:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472457:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472462:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472467:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.472469:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472475:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472482:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.472484:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.472487:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472502:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.472512:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c547dca7 reply state 00000000b07f1157 transno 8589950878 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.472520:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.472596:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283268:x1863919946716800:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1358us (1529us total) trans 8589950878 rc 0/0 00000100:00100000:2.0:1777580315.472605:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19684 00000100:00100000:2.0:1777580315.472610:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380339143 time 7836420089350 state 0x2 ref 0 00010000:00010000:2.0:1777580315.472648:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.472654:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472660:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.472663:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472669:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472677:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x828:0x0].0x0 (ffffa024aee2d200) 00010000:00010000:2.0:1777580315.472679:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.472681:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472686:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x828:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.472725:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.472727:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.472728:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.473382:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473392:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473398:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473403:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.473406:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473412:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473420:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0248a60e100) 00010000:00010000:2.0:1777580315.473423:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.473426:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473432:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c07d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473476:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473483:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473574:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473579:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.473582:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473589:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473598:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02493bbd000) 00010000:00010000:2.0:1777580315.473600:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.473604:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.473609:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c08b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.474560:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946716544 00000100:00100000:0.0:1777580315.474592:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946716544 00000100:00100000:0.0:1777580315.474669:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12003 00000100:00100000:0.0:1777580315.474681:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+40:2362:x1863919946716544:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580315.476397:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2362:x1863919946716544:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1709us (6982us total) trans 8589938629 rc 0/0 00000100:00100000:0.0:1777580315.476411:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12003 00000100:00100000:3.0:1777580315.488251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.488289:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.488381:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946717056 00000100:00100000:3.0:1777580315.488394:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946717056 00000100:00100000:3.0:1777580315.488444:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836373678693 time 7836380269510 state 0x0 ref 1 00000100:00100000:3.0:1777580315.488460:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380369510 time 7836380269510 state 0x1 ref 1 00000100:00100000:3.0:1777580315.488484:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946717312 00000100:00100000:3.0:1777580315.488487:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946717312 00000100:00100000:3.0:1777580315.488499:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380369510 time 7836380269510 state 0x1 ref 2 00000100:00100000:3.0:1777580315.488520:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836437482961 time 7836437382961 state 0x1 ref 2 00000100:00100000:3.0:1777580315.488533:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:283308:x1863919946717056:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.488610:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.488645:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c0a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9bd expref: 423 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.488668:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:3.0:1777580315.488680:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.488773:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.488789:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.488814:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.488995:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bc55e141 reply state 0000000065304b60 transno 8589950879 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.489020:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.489130:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+424:283308:x1863919946717056:12345-192.168.202.9@tcp:36:touch.500 Request processed in 598us (894us total) trans 8589950879 rc 0/0 00000100:00100000:3.0:1777580315.489166:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19685 00000100:00100000:3.0:1777580315.489193:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836437482961 time 7836438055307 state 0x0 ref 1 00000100:00100000:3.0:1777580315.489205:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+423:283312:x1863919946717312:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.489218:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.489231:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c0d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9c4 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489359:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489371:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489379:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489393:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489400:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.489408:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491129:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491167:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491174:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491180:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.491186:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491193:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491211:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024aee2db00) 00010000:00010000:1.0:1777580315.491214:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.491220:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.491238:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c0b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580315.491420:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c2:0x0], index 1: 0 00010000:00010000:3.0:1777580315.491634:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c0e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491649:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491660:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491700:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491707:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491714:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491719:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.491722:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491727:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491735:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.491738:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.491741:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491761:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c0d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.491775:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007cf8a18f reply state 00000000ebf3a80f transno 8589950880 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.491784:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.491842:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c0d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9c4 expref: 426 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491859:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9c4 expref: 425 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.491867:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa02499549300) 00010000:00010000:3.0:1777580315.491870:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.491872:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031600, rc 0) 00000100:00100000:3.0:1777580315.491964:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+426:283312:x1863919946717312:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2761us (3674us total) trans 8589950880 rc 0/0 00000100:00100000:3.0:1777580315.491974:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19686 00000100:00100000:3.0:1777580315.491983:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836437482961 time 7836438055307 state 0x2 ref 0 00000100:00100000:0.0:1777580315.509252:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.509308:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.509356:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946717696 00000100:00100000:3.0:1777580315.509379:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946717696 00000100:00100000:2.0:1777580315.509420:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946717568 00000100:00100000:2.0:1777580315.509434:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946717568 00000100:00100000:3.0:1777580315.509762:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836380339143 time 7836420089350 state 0x0 ref 1 00000100:00100000:3.0:1777580315.509779:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836420189350 time 7836420089350 state 0x1 ref 1 00000100:00100000:3.0:1777580315.509828:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836420189350 time 7836458689195 state 0x0 ref 1 00000100:00100000:2.0:1777580315.512464:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4216 00000100:00100000:2.0:1777580315.512480:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+426:283306:x1863919946717568:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580315.516185:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516205:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516214:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516220:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.516226:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516234:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516256:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02493bbd800) 00010000:00010000:1.0:1777580315.516259:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.516265:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.516272:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c0df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.517118:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+426:283306:x1863919946717568:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4630us (7869us total) trans 8589950881 rc 0/0 00000100:00100000:2.0:1777580315.517149:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4216 00010000:00010000:2.0:1777580315.517208:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517219:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517250:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517269:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.517274:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517282:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517299:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580315.517303:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.517307:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.517313:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c0ca lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.539460:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283292:x1863919946717696:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.539519:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.539558:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9cb expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539673:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539694:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539711:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539746:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539755:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539764:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539952:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.539963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.539968:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.539977:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540010:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.540031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00200000:3.0:1777580315.540038:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82a:0x0]: returning size 0 00000004:00200000:3.0:1777580315.540044:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1777580315.540063:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:3.0:1777580315.540071:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540087:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540097:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.540112:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540120:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540127:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.540158:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540167:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946717824 00010000:00010000:3.0:1777580315.540169:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540179:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946717824 00010000:00010000:3.0:1777580315.540186:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.540192:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.540198:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540206:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c0fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540226:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836437482961 time 7836438055307 state 0x0 ref 1 00010000:00010000:3.0:1777580315.540237:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540241:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836438155307 time 7836438055307 state 0x1 ref 1 00010000:00010000:3.0:1777580315.540253:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540260:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540266:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:1.0:1777580315.540269:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718080 00010000:00010000:3.0:1777580315.540270:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540273:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718080 00010000:00010000:3.0:1777580315.540281:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540291:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02498f4ad00) 00010000:00010000:3.0:1777580315.540294:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.540298:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540298:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836438155307 time 7836438055307 state 0x1 ref 2 00010000:00010000:3.0:1777580315.540313:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c102 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540323:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718336 00000100:00100000:1.0:1777580315.540326:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718336 00000100:00100000:1.0:1777580315.540337:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836438155307 time 7836438055307 state 0x1 ref 3 00000100:00100000:1.0:1777580315.540348:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836489310235 time 7836489210235 state 0x1 ref 3 00010000:00010000:3.0:1777580315.540359:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c0f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9cb expref: 142 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.540360:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:283308:x1863919946717824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.540377:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.540386:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9cb expref: 141 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.540393:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c110 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9d2 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.540416:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa02498aace00) 00010000:00010000:3.0:1777580315.540419:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.540422:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00010000:00010000:1.0:1777580315.540441:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c110 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x802:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d2 expref: 428 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.540454:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c110 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x802:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d2 expref: 428 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.540474:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa0241785fd00) 00010000:00010000:1.0:1777580315.540484:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580315.540487:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839a00, rc 0) 00000100:00100000:3.0:1777580315.540500:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283292:x1863919946717696:12345-192.168.202.9@tcp:101:rm.500 Request processed in 30642us (31189us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.540510:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19687 00000100:00100000:1.0:1777580315.540514:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+428:283308:x1863919946717824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 155us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.540520:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836420189350 time 7836458689195 state 0x2 ref 0 00000100:00100000:1.0:1777580315.540526:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19688 00000100:00100000:1.0:1777580315.540552:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718464 00000100:00100000:3.0:1777580315.540556:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718592 00000100:00100000:1.0:1777580315.540556:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718464 00000100:00100000:3.0:1777580315.540562:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718592 00000100:00100000:1.0:1777580315.540569:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836420189350 time 7836458689195 state 0x0 ref 1 00000100:00100000:1.0:1777580315.540577:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836458789195 time 7836458689195 state 0x1 ref 1 00000100:00100000:3.0:1777580315.541550:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836458789195 time 7836458689195 state 0x1 ref 2 00000100:00100000:3.0:1777580315.541581:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836490543858 time 7836490443858 state 0x1 ref 2 00000100:00100000:3.0:1777580315.542102:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283295:x1863919946718464:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.542127:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.542176:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c117 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9e0 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542253:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542268:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542281:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542321:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542329:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.542336:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.542980:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836491933079 time 7836491833079 state 0x1 ref 2 00000100:00100000:2.0:1777580315.543013:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:283312:x1863919946718080:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580315.543080:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580315.543107:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c0e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9c4 expref: 427 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543131:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa02499549300) 00010000:00010000:2.0:1777580315.543157:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.543225:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543251:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543260:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.543389:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006ca5d3bd reply state 00000000a0bdadec transno 8589950882 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.543398:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.543486:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+428:283312:x1863919946718080:12345-192.168.202.9@tcp:36:touch.500 Request processed in 489us (3475us total) trans 8589950882 rc 0/0 00000100:00100000:2.0:1777580315.543494:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19689 00000100:00100000:2.0:1777580315.543521:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836490543858 time 7836492383671 state 0x0 ref 2 00000100:00100000:2.0:1777580315.543532:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283298:x1863919946718592:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.543543:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.543553:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c133 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9e7 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543612:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543621:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543629:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543653:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543660:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543666:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543759:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543768:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543775:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580315.543797:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82c:0x0]: returning size 0 00000004:00200000:2.0:1777580315.543814:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580315.543829:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543840:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543848:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543855:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543871:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543876:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.543879:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543886:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543895:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.543898:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.543901:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543906:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c13a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543917:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543922:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543927:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543931:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.543934:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543950:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543959:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024aee2df00) 00010000:00010000:2.0:1777580315.543961:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.543964:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543971:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c141 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.543998:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c133 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e7 expref: 145 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544010:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e7 expref: 144 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544018:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02488b77800) 00010000:00010000:2.0:1777580315.544020:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580315.544023:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:2.0:1777580315.544048:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283298:x1863919946718592:12345-192.168.202.9@tcp:101:rm.500 Request processed in 517us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.544055:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19692 00000100:00100000:2.0:1777580315.544075:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836491933079 time 7836492938342 state 0x0 ref 1 00000100:00100000:2.0:1777580315.544087:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+427:283313:x1863919946718336:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580315.544096:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.544111:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c14f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9d9 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544202:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544212:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544218:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544228:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544235:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.544241:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580315.544707:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e7:0x0], index 0: 0 00010000:00010000:3.0:1777580315.545235:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545253:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545266:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580315.545305:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82b:0x0]: returning size 0 00000004:00200000:3.0:1777580315.545310:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580315.545331:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545344:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545355:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545361:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545389:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545409:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.545413:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545421:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545434:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.545437:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.545831:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545841:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c11e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545858:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545864:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545870:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545875:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.545877:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545896:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545905:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024989ec600) 00010000:00010000:3.0:1777580315.545908:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.545911:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.545917:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c125 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.546044:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c117 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e0 expref: 144 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.546061:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e0 expref: 143 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.546068:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa024b7eb0b00) 00010000:00010000:3.0:1777580315.546070:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.546073:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:3.0:1777580315.546170:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283295:x1863919946718464:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4577us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.546181:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19691 00000100:00100000:3.0:1777580315.546190:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836490543858 time 7836492383671 state 0x2 ref 0 00010000:00010000:2.0:1777580315.550456:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c16b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550481:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c16b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550496:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c16b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550541:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550571:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550581:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.550588:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.551579:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.551592:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.551817:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.551820:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.551826:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.551834:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c156 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.551853:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e9854acd reply state 00000000806a876d transno 8589950883 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.551862:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580315.551918:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c14f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d9 expref: 430 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.552590:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c16b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d9 expref: 429 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.552692:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa024aee2db00) 00010000:00010000:2.0:1777580315.552694:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580315.552697:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fe00, rc 0) 00000100:00100000:2.0:1777580315.553158:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+430:283313:x1863919946718336:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9044us (13097us total) trans 8589950883 rc 0/0 00000100:00100000:2.0:1777580315.553173:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19690 00000100:00100000:2.0:1777580315.553187:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836491933079 time 7836492938342 state 0x2 ref 0 00000100:00100000:1.0:1777580315.563933:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.563971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580315.564030:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564049:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564058:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564064:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.564070:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564079:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564097:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa024aee2d200) 00010000:00010000:2.0:1777580315.564100:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.564105:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.564162:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c12c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.565380:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718720 00000100:00100000:3.0:1777580315.567818:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718720 00000100:00100000:3.0:1777580315.567905:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836491933079 time 7836492938342 state 0x0 ref 1 00000100:00100000:3.0:1777580315.568099:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836493038342 time 7836492938342 state 0x1 ref 1 00000100:00100000:3.0:1777580315.568163:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836493038342 time 7836517024744 state 0x0 ref 1 00000100:00100000:3.0:1777580315.568185:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+429:283312:x1863919946718720:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.568222:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.568253:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c179 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9ee expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.568331:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c179 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x803:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9ee expref: 430 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.572127:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.574605:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718848 00000100:00100000:0.0:1777580315.574625:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718848 00000100:00100000:0.0:1777580315.574700:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946718976 00000100:00100000:0.0:1777580315.574704:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946718976 00000100:00100000:0.0:1777580315.574739:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12004 00000100:00100000:0.0:1777580315.574751:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946718848:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580315.575302:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946718848:12345-192.168.202.9@tcp:2:touch.500 Request processed in 550us (11326us total) trans 8589939029 rc 0/0 00000100:00100000:0.0:1777580315.575311:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12004 00000100:00100000:0.0:1777580315.575338:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12005 00000100:00100000:0.0:1777580315.575345:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946718976:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.575358:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.575396:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9f5 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580315.575422:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e4:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580315.575440:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.575442:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.575471:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 45 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.575493:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 45 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.575510:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:0.0:1777580315.575537:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946718976:12345-192.168.202.9@tcp:101:rm.500 Request processed in 191us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.575548:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12005 00000100:00100000:1.0:1777580315.575600:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.577927:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580315.577978:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.577991:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578000:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578006:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.578012:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578021:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578059:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024aee2d800) 00010000:00010000:1.0:1777580315.578062:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.578068:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578075:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c15d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.578128:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946719360 00000100:00100000:1.0:1777580315.578165:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946719360 00000100:00100000:1.0:1777580315.578214:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836517124744 time 7836517024744 state 0x1 ref 2 00000100:00100000:1.0:1777580315.578234:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946719616 00000100:00100000:1.0:1777580315.578237:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946719616 00000100:00100000:1.0:1777580315.578248:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836517124744 time 7836517024744 state 0x1 ref 3 00000100:00100000:1.0:1777580315.578269:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836527231004 time 7836527131004 state 0x1 ref 3 00000100:00100000:1.0:1777580315.578281:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+431:283313:x1863919946719360:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580315.578356:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580315.578374:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c16b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d9 expref: 431 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578385:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa024aee2db00) 00010000:00010000:1.0:1777580315.578393:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580315.578480:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578495:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.578512:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580315.581892:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ee9c0a6b reply state 00000000ea94521a transno 8589950884 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.581919:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580315.582092:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+432:283313:x1863919946719360:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3807us (6487us total) trans 8589950884 rc 0/0 00000100:00100000:1.0:1777580315.582104:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19694 00000100:00100000:1.0:1777580315.582179:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836527231004 time 7836531038943 state 0x0 ref 2 00000100:00100000:1.0:1777580315.582197:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+431:283316:x1863919946719616:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.582220:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.582240:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c18e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea03 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586625:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586657:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586671:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586690:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586717:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.586723:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580315.587404:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c3:0x0], index 1: 0 00010000:00010000:1.0:1777580315.587625:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4c1a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587639:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4c1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587649:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4c1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587696:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587704:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587713:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587719:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.587725:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587734:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587761:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580315.587764:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.587770:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.587777:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c195 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580315.587794:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000431844da reply state 00000000c3422fda transno 8589950885 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.589496:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c179 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x803:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9ee expref: 433 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.589564:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580315.589568:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580315.589573:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:3.0:1777580315.589694:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+433:283312:x1863919946718720:12345-192.168.202.9@tcp:101:touch.500 Request processed in 21515us (25776us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.589708:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19693 00000100:00100000:3.0:1777580315.589855:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.592309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.596521:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.596574:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.596585:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720000 00000100:00100000:3.0:1777580315.596687:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946719744 00000100:00100000:3.0:1777580315.596700:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946719744 00000100:00100000:2.0:1777580315.598530:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720000 00000100:00100000:2.0:1777580315.598689:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4217 00000100:00100000:2.0:1777580315.598700:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+433:283308:x1863919946720000:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.599294:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:283308:x1863919946720000:12345-192.168.202.9@tcp:35:touch.500 Request processed in 595us (2784us total) trans 8589950886 rc 0/0 00000100:00100000:2.0:1777580315.599303:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4217 00000100:00100000:3.0:1777580315.602477:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946719104 00000100:00100000:3.0:1777580315.602495:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946719104 00000100:00100000:3.0:1777580315.602571:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12006 00000100:00100000:1.0:1777580315.602922:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580315.602968:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720256 00000100:00100000:1.0:1777580315.602975:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720256 00000100:00100000:1.0:1777580315.603011:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836490543858 time 7836492383671 state 0x0 ref 1 00000100:00100000:1.0:1777580315.603024:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836492483671 time 7836492383671 state 0x1 ref 1 00000100:00100000:1.0:1777580315.603060:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836492483671 time 7836551922574 state 0x0 ref 1 00000100:00100000:3.0:1777580315.603100:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02484c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+46:2361:x1863919946719744:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.603131:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.603184:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea0a expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580315.603219:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e3:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:3.0:1777580315.603246:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580315.603248:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580315.608276:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283298:x1863919946720256:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580315.608383:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580315.608425:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c148 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e7 expref: 143 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608459:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4bd4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e931 expref: 142 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608475:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02488b77800) 00010000:00010000:1.0:1777580315.608513:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580315.608551:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608569:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608581:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608600:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608708:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608717:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608892:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608901:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.608908:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580315.609560:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1889, 64 off129088 00010000:00010000:1.0:1777580315.612451:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612483:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612517:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612527:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612534:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612541:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.612581:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580315.613315:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 47 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.613347:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 47 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.613457:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9800, rc 0) 00010000:00010000:2.0:1777580315.613523:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.613537:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.613549:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.613553:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.613563:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.613583:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02498aac600) 00010000:00010000:2.0:1777580315.613587:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.613591:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.613609:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c1cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.613656:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.613658:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.613660:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580315.613700:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02484c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+47:2361:x1863919946719744:12345-192.168.202.9@tcp:101:rm.500 Request processed in 11115us (23841us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580315.614791:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614816:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614824:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614831:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.614836:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614844:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614861:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82c:0x0].0x0 (ffffa02498aac600) 00010000:00010000:1.0:1777580315.614864:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580315.614887:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614894:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c1c6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614941:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614948:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614953:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614959:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.614962:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614969:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614977:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580315.614980:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.614983:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.614989:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838800/0xcb2b2f2f7e4c1b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580315.615000:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000062ac04fe reply state 0000000098f2c38e transno 8589950887 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.615020:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580315.615118:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283298:x1863919946720256:12345-192.168.202.9@tcp:36:rm.500 Request processed in 12044us (18541us total) trans 8589950887 rc 0/0 00000100:00100000:1.0:1777580315.615128:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19696 00000100:00100000:1.0:1777580315.615155:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836492483671 time 7836551922574 state 0x2 ref 0 00000100:00100000:1.0:1777580315.615271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.618959:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12007 00000100:00100000:0.0:1777580315.619000:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+47:2363:x1863919946719104:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.619031:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.619063:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90e9fc expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580315.619104:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e2:0x0] initial LVB size: 0, mtime: 0x69f3b919, atime: 0x69f3b919, ctime: 0x69f3b919, blocks: 0x1 00010000:00010000:0.0:1777580315.619149:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.619152:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.619164:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 48 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.619186:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 48 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.619203:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:0.0:1777580315.619300:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+48:2363:x1863919946719104:12345-192.168.202.9@tcp:101:rm.500 Request processed in 324us (27003us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580315.620161:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720384 00000100:00100000:1.0:1777580315.620175:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720384 00000100:00100000:1.0:1777580315.620231:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836531138943 time 7836531038943 state 0x1 ref 2 00000100:00100000:1.0:1777580315.620274:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836531138943 time 7836569136301 state 0x0 ref 2 00000100:00100000:1.0:1777580315.620290:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:283313:x1863919946720384:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.620311:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.620340:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4c1db lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea11 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.620415:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4c1db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x804:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea11 expref: 435 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.620432:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4c1db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x804:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea11 expref: 435 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.620452:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa0241785f300) 00010000:00010000:1.0:1777580315.620456:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580315.620473:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86200, rc 0) 00000100:00100000:1.0:1777580315.620524:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+435:283313:x1863919946720384:12345-192.168.202.9@tcp:101:touch.500 Request processed in 239us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580315.620533:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19697 00000100:00100000:3.0:1777580315.621401:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12006 00010000:00010000:3.0:1777580315.621456:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621469:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621477:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621509:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.621516:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621525:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621543:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580315.621546:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.621551:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.621558:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838e00/0xcb2b2f2f7e4c187 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.621691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.621840:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720512 00000100:00100000:2.0:1777580315.621854:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720512 00000100:00100000:2.0:1777580315.621930:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12008 00000100:00100000:2.0:1777580315.622808:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+41:2362:x1863919946720512:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580315.623452:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2362:x1863919946720512:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1511us (1759us total) trans 8589938630 rc 0/0 00000100:00100000:2.0:1777580315.623462:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12008 00010000:00010000:1.0:1777580315.624983:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625004:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625012:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625019:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.625025:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625034:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625055:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0241785f100) 00010000:00010000:1.0:1777580315.625060:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.625064:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625071:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c1bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625193:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c18e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea03 expref: 434 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625243:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4c1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea03 expref: 433 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.625252:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa0241785f000) 00010000:00010000:1.0:1777580315.625255:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580315.625258:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838200, rc 0) 00000100:00100000:1.0:1777580315.625347:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:283316:x1863919946719616:12345-192.168.202.9@tcp:101:touch.500 Request processed in 43155us (47428us total) trans 8589950885 rc 0/0 00000100:00100000:1.0:1777580315.625358:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19695 00000100:00100000:1.0:1777580315.625368:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836531138943 time 7836569136301 state 0x2 ref 0 00000100:00100000:3.0:1777580315.628673:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.628742:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.628743:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720768 00000100:00100000:2.0:1777580315.628758:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720768 00000100:00100000:0.0:1777580315.628842:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12007 00010000:00010000:3.0:1777580315.628845:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628860:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628868:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628874:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.628880:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628912:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628932:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0241785f800) 00010000:00010000:3.0:1777580315.628943:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.628950:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.628957:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839e00/0xcb2b2f2f7e4c19c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.629452:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836492483671 time 7836551922574 state 0x0 ref 1 00000100:00100000:2.0:1777580315.629469:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836552022574 time 7836551922574 state 0x1 ref 1 00000100:00100000:2.0:1777580315.629507:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836552022574 time 7836578369833 state 0x0 ref 1 00000100:00100000:2.0:1777580315.629524:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283295:x1863919946720768:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:3.0:1777580315.629547:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580315.629585:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580315.629682:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c164 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9e0 expref: 142 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629706:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4bc78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8dd expref: 141 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629828:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580315.629842:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.629870:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629885:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629895:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629910:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629918:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.629924:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.630376:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.630386:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.630393:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.631564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580315.632401:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946720896 00000100:00100000:1.0:1777580315.632417:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946720896 00000100:00100000:1.0:1777580315.632492:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12009 00000100:00100000:1.0:1777580315.632503:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946720896:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580315.632932:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946720896:12345-192.168.202.9@tcp:2:touch.500 Request processed in 430us (4191us total) trans 8589939030 rc 0/0 00000100:00100000:1.0:1777580315.632940:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12009 00000040:00080000:2.0:1777580315.635314:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1890, 64 off129152 00010000:00010000:2.0:1777580315.635403:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635429:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635442:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635452:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635458:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635465:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635498:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580315.635521:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635528:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635534:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635541:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.635544:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635552:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635574:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa024aee2df00) 00010000:00010000:2.0:1777580315.635576:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580315.635581:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635586:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c1f0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635619:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635625:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635630:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635635:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.635637:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635643:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635651:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.635653:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.635658:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.635662:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c1e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.635682:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005019ad1c reply state 000000009ae39805 transno 8589950888 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.635690:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.635786:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+142:283295:x1863919946720768:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6265us (7123us total) trans 8589950888 rc 0/0 00000100:00100000:2.0:1777580315.635796:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19698 00000100:00100000:2.0:1777580315.635818:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836552022574 time 7836578369833 state 0x2 ref 0 00000100:00100000:3.0:1777580315.637698:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.642898:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946721408 00000100:00100000:2.0:1777580315.642914:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946721408 00000100:00100000:2.0:1777580315.643037:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836531138943 time 7836569136301 state 0x0 ref 1 00000100:00100000:2.0:1777580315.643050:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836569236301 time 7836569136301 state 0x1 ref 1 00000100:00100000:2.0:1777580315.643088:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836569236301 time 7836591951413 state 0x0 ref 1 00000100:00100000:2.0:1777580315.643333:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+433:283316:x1863919946721408:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580315.643393:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580315.643419:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4c1a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea03 expref: 433 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.643436:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa0241785f000) 00010000:00010000:2.0:1777580315.643447:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.643518:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.643531:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.643558:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.644426:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fb2969f6 reply state 000000003eef2060 transno 8589950889 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.644438:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.644542:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:283316:x1863919946721408:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1212us (12982us total) trans 8589950889 rc 0/0 00000100:00100000:2.0:1777580315.644552:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19699 00000100:00100000:2.0:1777580315.644561:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836569236301 time 7836591951413 state 0x2 ref 0 00000100:00100000:2.0:1777580315.645324:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946721152 00000100:00100000:2.0:1777580315.645333:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946721152 00000100:00100000:2.0:1777580315.645405:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4218 00000100:00100000:2.0:1777580315.645419:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+434:283312:x1863919946721152:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.647088:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+435:283312:x1863919946721152:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1666us (17534us total) trans 8589950890 rc 0/0 00000100:00100000:2.0:1777580315.647635:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4218 00010000:00010000:2.0:1777580315.647696:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580315.647706:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.647727:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580315.647732:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.647744:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.647791:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82b:0x0].0x0 (ffffa024aee2df00) 00010000:00010000:2.0:1777580315.647795:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580315.647809:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.647816:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c1f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.647837:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.647838:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580315.647840:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580315.654871:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946721664 00000100:00100000:1.0:1777580315.654895:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946721664 00000100:00100000:1.0:1777580315.654980:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836569236301 time 7836591951413 state 0x0 ref 1 00000100:00100000:1.0:1777580315.654996:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836592051413 time 7836591951413 state 0x1 ref 1 00000100:00100000:1.0:1777580315.655043:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836592051413 time 7836603904416 state 0x0 ref 1 00000100:00100000:1.0:1777580315.655084:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+435:283318:x1863919946721664:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.655111:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.655150:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c205 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea18 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655330:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655348:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655361:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655377:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655384:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.655391:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580315.656020:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e8:0x0], index 0: 0 00010000:00010000:1.0:1777580315.656312:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c21a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656326:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656338:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656398:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656406:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656414:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656421:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.656426:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656434:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656448:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580315.656451:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.656456:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656462:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c20c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580315.656478:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bb10f19a reply state 00000000b985ba9f transno 8589950891 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.656488:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580315.656532:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c205 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea18 expref: 438 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656563:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea18 expref: 437 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.656572:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248e788100) 00010000:00010000:1.0:1777580315.656574:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580315.656577:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6800, rc 0) 00000100:00100000:1.0:1777580315.658217:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+438:283318:x1863919946721664:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3128us (20519us total) trans 8589950891 rc 0/0 00000100:00100000:1.0:1777580315.658232:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19700 00000100:00100000:1.0:1777580315.658243:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836592051413 time 7836603904416 state 0x2 ref 0 00000100:00100000:3.0:1777580315.658300:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580315.658315:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658326:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658334:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658341:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.658346:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658354:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658373:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024aee2d200) 00000100:00100000:3.0:1777580315.658391:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580315.658397:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.658404:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658412:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c1e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.658445:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.658450:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946722048 00010000:00010000:3.0:1777580315.658462:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.658464:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946721792 00000100:00100000:2.0:1777580315.658468:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946722048 00000100:00100000:1.0:1777580315.658474:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946721792 00010000:00010000:3.0:1777580315.658481:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.658490:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.658494:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.658514:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836592051413 time 7836603904416 state 0x0 ref 1 00000100:00100000:1.0:1777580315.658528:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836604004416 time 7836603904416 state 0x1 ref 1 00000100:00100000:2.0:1777580315.658578:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4219 00000100:00100000:1.0:1777580315.658580:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836604004416 time 7836607441145 state 0x0 ref 1 00000100:00100000:2.0:1777580315.658597:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:283313:x1863919946722048:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580315.658604:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:283316:x1863919946721792:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.658639:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.658660:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c228 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea1f expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658725:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c228 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x805:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea1f expref: 440 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658739:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c228 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x805:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea1f expref: 440 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.658764:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:1.0:1777580315.658767:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580315.658771:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00000100:00100000:1.0:1777580315.658864:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+441:283316:x1863919946721792:12345-192.168.202.9@tcp:101:touch.500 Request processed in 269us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580315.658871:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19701 00000100:00100000:1.0:1777580315.658876:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836604004416 time 7836607441145 state 0x2 ref 0 00000100:00100000:2.0:1777580315.659062:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:283313:x1863919946722048:12345-192.168.202.9@tcp:35:touch.500 Request processed in 469us (668us total) trans 8589950892 rc 0/0 00000100:00100000:2.0:1777580315.659070:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4219 00010000:00010000:3.0:1777580315.659185:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.659208:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:3.0:1777580315.659212:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.659215:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.659221:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c1fe lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.661276:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580315.661917:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661934:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661942:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661949:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.661954:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661962:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661980:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02498aac800) 00010000:00010000:1.0:1777580315.661983:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.661987:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.661994:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c213 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.662348:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946722304 00000100:00100000:0.0:1777580315.662361:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946722304 00000100:00100000:0.0:1777580315.662419:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836552022574 time 7836578369833 state 0x0 ref 1 00000100:00100000:0.0:1777580315.662433:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836578469833 time 7836578369833 state 0x1 ref 1 00000100:00100000:0.0:1777580315.662468:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836578469833 time 7836611329802 state 0x0 ref 1 00000100:00100000:0.0:1777580315.662482:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283292:x1863919946722304:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580315.662560:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580315.662585:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c109 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9cb expref: 141 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.663832:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4600/0xcb2b2f2f7e4bc1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e8c1 expref: 140 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.663859:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa02498aace00) 00010000:00010000:0.0:1777580315.663873:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.663917:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.663936:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.663949:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.663997:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.664005:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.664011:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.664191:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.664201:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.664208:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580315.672257:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1891, 64 off129216 00010000:00010000:0.0:1777580315.672372:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672409:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672423:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672434:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672441:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672459:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672492:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580315.672526:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672533:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672540:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672546:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.672551:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672560:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672574:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:0.0:1777580315.672577:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580315.672582:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672589:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c23d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672618:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672637:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672643:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672649:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.672653:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672659:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672668:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.672670:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.672673:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.672680:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c22f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.672692:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008643bfa4 reply state 00000000673d1f6f transno 8589950893 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.672703:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.672856:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283292:x1863919946722304:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10369us (11584us total) trans 8589950893 rc 0/0 00000100:00100000:0.0:1777580315.672870:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19702 00000100:00100000:0.0:1777580315.672880:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836578469833 time 7836611329802 state 0x2 ref 0 00010000:00010000:3.0:1777580315.673426:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580315.673437:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.673447:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580315.673451:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.673458:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.673470:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82a:0x0].0x0 (ffffa0248a60e100) 00010000:00010000:3.0:1777580315.673473:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580315.673476:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.673482:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c244 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.673500:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.673502:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580315.673514:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580315.682316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.682414:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946722560 00000100:00100000:3.0:1777580315.682426:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.682431:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946722560 00000100:00100000:3.0:1777580315.682480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.682489:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836604004416 time 7836607441145 state 0x0 ref 1 00000100:00100000:0.0:1777580315.682504:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836607541145 time 7836607441145 state 0x1 ref 1 00000100:00100000:0.0:1777580315.682538:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946722816 00000100:00100000:0.0:1777580315.682541:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946722816 00000100:00100000:0.0:1777580315.682559:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836607541145 time 7836607441145 state 0x1 ref 2 00000100:00100000:0.0:1777580315.682575:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836631538714 time 7836631438714 state 0x1 ref 2 00000100:00100000:0.0:1777580315.682590:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:283318:x1863919946722560:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.682662:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.682662:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.682680:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682689:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682696:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.682702:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682711:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682729:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0248a60ec00) 00010000:00010000:0.0:1777580315.682733:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c21a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea18 expref: 439 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682735:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.682742:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.682756:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c236 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.682767:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248e788100) 00010000:00010000:0.0:1777580315.682782:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.682871:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.682885:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.682895:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.683042:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e3cff14 reply state 000000002318ddac transno 8589950894 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.683064:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580315.683200:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:283318:x1863919946722560:12345-192.168.202.9@tcp:36:touch.500 Request processed in 614us (2830us total) trans 8589950894 rc 0/0 00000100:00100000:0.0:1777580315.683207:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19703 00000100:00100000:0.0:1777580315.683230:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836631538714 time 7836632092695 state 0x0 ref 1 00000100:00100000:0.0:1777580315.683240:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+439:283319:x1863919946722816:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580315.683249:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.683261:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c252 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea26 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683371:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683383:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683392:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683405:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683412:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.683418:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580315.683868:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c4:0x0], index 1: 0 00010000:00010000:0.0:1777580315.683996:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c267 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684006:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684013:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684043:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684050:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684055:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684060:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.684064:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684070:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684078:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.684081:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.684085:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684102:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c259 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.684116:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003503c63b reply state 00000000a6cfaa83 transno 8589950895 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.684123:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580315.684170:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c252 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea26 expref: 442 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684182:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c267 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea26 expref: 441 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.684188:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:0.0:1777580315.684191:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.684192:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b200, rc 0) 00000100:00100000:0.0:1777580315.684236:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+442:283319:x1863919946722816:12345-192.168.202.9@tcp:101:touch.500 Request processed in 998us (1812us total) trans 8589950895 rc 0/0 00000100:00100000:0.0:1777580315.684243:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19704 00000100:00100000:0.0:1777580315.684247:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836631538714 time 7836632092695 state 0x2 ref 0 00000100:00100000:2.0:1777580315.684700:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946722944 00000100:00100000:2.0:1777580315.684707:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946722944 00000100:00100000:2.0:1777580315.684845:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12010 00000100:00100000:2.0:1777580315.684853:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+42:2364:x1863919946722944:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580315.685351:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+43:2364:x1863919946722944:12345-192.168.202.9@tcp:2:touch.500 Request processed in 497us (2869us total) trans 8589938631 rc 0/0 00000100:00100000:2.0:1777580315.685358:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12010 00000100:00100000:3.0:1777580315.691340:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.691514:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692539:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692549:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692555:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.692561:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692571:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692600:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0248a60ef00) 00010000:00010000:3.0:1777580315.692604:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.692610:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.692617:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c260 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693063:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693092:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693099:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693104:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.693108:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693114:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693125:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248a60eb00) 00010000:00010000:1.0:1777580315.693127:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.693131:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693162:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c24b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.693205:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946723072 00000100:00100000:1.0:1777580315.693218:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946723072 00000100:00100000:1.0:1777580315.693267:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836631538714 time 7836632092695 state 0x0 ref 1 00000100:00100000:1.0:1777580315.693281:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836632192695 time 7836632092695 state 0x1 ref 1 00000100:00100000:1.0:1777580315.693312:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836632192695 time 7836642173706 state 0x0 ref 1 00000100:00100000:1.0:1777580315.693333:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+440:283318:x1863919946723072:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580315.693372:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580315.693396:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c275 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea2d expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693477:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x806:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea2d expref: 441 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693493:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x806:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea2d expref: 441 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.693512:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248e788800) 00010000:00010000:1.0:1777580315.693515:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580315.693518:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839000, rc 0) 00000100:00100000:1.0:1777580315.693593:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+441:283318:x1863919946723072:12345-192.168.202.9@tcp:101:touch.500 Request processed in 270us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580315.693601:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19705 00000100:00100000:1.0:1777580315.693607:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836632192695 time 7836642173706 state 0x2 ref 0 00000100:00100000:3.0:1777580315.709097:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.709184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.709196:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946723328 00000100:00100000:3.0:1777580315.709224:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.709235:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946723328 00000100:00100000:2.0:1777580315.709320:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4220 00000100:00100000:3.0:1777580315.714937:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.715008:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946723712 00000100:00100000:3.0:1777580315.715021:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946723712 00000100:00100000:3.0:1777580315.715074:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836632192695 time 7836642173706 state 0x0 ref 1 00000100:00100000:3.0:1777580315.715090:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836642273706 time 7836642173706 state 0x1 ref 1 00000100:00100000:3.0:1777580315.715127:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946723968 00000100:00100000:3.0:1777580315.715131:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946723968 00000100:00100000:3.0:1777580315.715165:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836642273706 time 7836642173706 state 0x1 ref 2 00000100:00100000:3.0:1777580315.715187:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836664149250 time 7836664049250 state 0x1 ref 2 00000100:00100000:3.0:1777580315.715199:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238941ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+443:283320:x1863919946723712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.715232:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.715261:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c27c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea34 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.716972:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.717001:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.717017:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.717037:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.717045:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.717052:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580315.720939:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e9:0x0], index 0: 0 00010000:00010000:3.0:1777580315.721275:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4c291 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.721897:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4c291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.721914:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4c291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.721983:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.721992:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.721998:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722005:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.722009:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722017:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722032:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.722035:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.722040:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722046:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c283 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.722077:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007266ee64 reply state 0000000095b6d6bc transno 8589950896 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.722087:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.722159:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c27c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea34 expref: 446 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722176:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4c291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea34 expref: 445 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.722183:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580315.722186:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.722189:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e87a00, rc 0) 00000100:00100000:3.0:1777580315.722304:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238941ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+446:283320:x1863919946723712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7107us (13083us total) trans 8589950896 rc 0/0 00000100:00100000:3.0:1777580315.722316:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19706 00000100:00100000:3.0:1777580315.722368:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836664149250 time 7836671227208 state 0x0 ref 1 00000100:00100000:2.0:1777580315.722770:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946723456 00000100:00100000:2.0:1777580315.722788:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946723456 00000100:00100000:2.0:1777580315.722881:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12011 00000100:00100000:2.0:1777580315.722895:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2362:x1863919946723456:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580315.724583:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+445:283319:x1863919946723968:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.724762:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.724924:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c267 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea26 expref: 445 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.724950:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa024ad9fd900) 00010000:00010000:3.0:1777580315.724963:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.725055:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.725082:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.725093:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.726849:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008462af8d reply state 0000000074ab5601 transno 8589950897 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.726870:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.727021:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238941d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+446:283319:x1863919946723968:12345-192.168.202.9@tcp:36:touch.500 Request processed in 4638us (12095us total) trans 8589950897 rc 0/0 00000100:00100000:3.0:1777580315.727032:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19707 00000100:00100000:3.0:1777580315.727042:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836664149250 time 7836671227208 state 0x2 ref 0 00000100:00100000:2.0:1777580315.731578:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+445:283316:x1863919946723328:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580315.732617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.732640:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.732702:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580315.732735:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732746:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732753:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732758:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.732763:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732791:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732821:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:3.0:1777580315.732824:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.732829:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.732836:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4c29f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.732880:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946724096 00000100:00100000:3.0:1777580315.732888:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946724096 00000100:00100000:3.0:1777580315.732921:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836664149250 time 7836671227208 state 0x0 ref 1 00000100:00100000:3.0:1777580315.732932:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836671327208 time 7836671227208 state 0x1 ref 1 00000100:00100000:3.0:1777580315.732957:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946724480 00000100:00100000:3.0:1777580315.732960:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946724480 00000100:00100000:3.0:1777580315.732971:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836671327208 time 7836671227208 state 0x1 ref 2 00000100:00100000:3.0:1777580315.732983:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946724608 00000100:00100000:3.0:1777580315.732986:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946724608 00000100:00100000:3.0:1777580315.732995:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836671327208 time 7836671227208 state 0x1 ref 3 00000100:00100000:3.0:1777580315.733014:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836681976075 time 7836681876075 state 0x1 ref 3 00000100:00100000:3.0:1777580315.733027:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:283319:x1863919946724096:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.733041:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.733066:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c2a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea3b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733129:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x807:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea3b expref: 449 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733163:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x807:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea3b expref: 449 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733185:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa02490544700) 00010000:00010000:3.0:1777580315.733188:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580315.733191:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1200, rc 0) 00000100:00100000:3.0:1777580315.733248:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+449:283319:x1863919946724096:12345-192.168.202.9@tcp:101:touch.500 Request processed in 222us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.733256:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19708 00000100:00100000:3.0:1777580315.733274:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682238111 time 7836682138111 state 0x1 ref 2 00000100:00100000:3.0:1777580315.733283:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:283320:x1863919946724480:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580315.733317:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580315.733333:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4c291 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea34 expref: 448 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733344:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580315.733351:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580315.733409:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733417:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.733433:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.733838:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000038e0bce9 reply state 000000000fc61920 transno 8589950899 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.733849:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580315.733905:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+449:283320:x1863919946724480:12345-192.168.202.9@tcp:36:touch.500 Request processed in 621us (1261us total) trans 8589950899 rc 0/0 00000100:00100000:3.0:1777580315.733912:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19709 00000100:00100000:3.0:1777580315.733932:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682238111 time 7836682795119 state 0x0 ref 1 00000100:00100000:3.0:1777580315.733943:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+448:283324:x1863919946724608:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.733953:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.733964:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c2b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea42 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734064:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734077:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734085:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734112:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734130:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734163:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580315.734641:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c5:0x0], index 1: 0 00010000:00010000:3.0:1777580315.734788:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c2c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734813:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734823:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734860:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734867:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734872:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734878:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.734881:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734888:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734912:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.734914:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.734918:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734924:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c2bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.734937:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e02384fc reply state 00000000fd0359c4 transno 8589950900 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.734944:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.734971:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c2b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea42 expref: 451 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734984:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea42 expref: 450 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.734992:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:3.0:1777580315.734994:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.734997:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149600, rc 0) 00000100:00100000:3.0:1777580315.735039:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+451:283324:x1863919946724608:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1098us (2337us total) trans 8589950900 rc 0/0 00000100:00100000:3.0:1777580315.735047:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19710 00000100:00100000:3.0:1777580315.735053:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682238111 time 7836682795119 state 0x2 ref 0 00000100:00100000:2.0:1777580315.735994:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+450:283316:x1863919946723328:12345-192.168.202.9@tcp:35:touch.500 Request processed in 26659us (26906us total) trans 8589950898 rc 0/0 00000100:00100000:2.0:1777580315.736005:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4220 00010000:00010000:1.0:1777580315.737010:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737033:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737042:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737048:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.737055:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737085:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737105:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0248a60e100) 00010000:00010000:1.0:1777580315.737108:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.737114:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.737121:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c28a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756657:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756681:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756690:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756697:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.756702:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756710:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756733:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:1.0:1777580315.756736:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.756742:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.756760:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c2ad lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.759976:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c63aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2362:x1863919946723456:12345-192.168.202.9@tcp:2:touch.500 Request processed in 37071us (50779us total) trans 8589939031 rc 0/0 00000100:00100000:2.0:1777580315.759989:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12011 00000100:00100000:0.0:1777580315.765103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.765195:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.765225:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.765238:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946724736 00000100:00100000:0.0:1777580315.765243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.765253:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946724736 00000100:00100000:0.0:1777580315.765261:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.765336:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682238111 time 7836682795119 state 0x0 ref 1 00000100:00100000:3.0:1777580315.765356:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682895119 time 7836682795119 state 0x1 ref 1 00000100:00100000:0.0:1777580315.765647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.766018:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.766063:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.766200:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946724992 00000100:00100000:3.0:1777580315.766209:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946724992 00000100:00100000:3.0:1777580315.766249:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836682895119 time 7836682795119 state 0x1 ref 2 00000100:00100000:3.0:1777580315.766266:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725120 00000100:00100000:3.0:1777580315.766269:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725120 00000100:00100000:3.0:1777580315.766281:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836578469833 time 7836611329802 state 0x0 ref 1 00000100:00100000:0.0:1777580315.766283:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.766289:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 1 00000100:00100000:3.0:1777580315.766296:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725248 00000100:00100000:3.0:1777580315.766299:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725248 00000100:00100000:0.0:1777580315.766303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.766310:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 2 00000100:00100000:3.0:1777580315.766316:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725376 00000100:00100000:3.0:1777580315.766319:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725376 00000100:00100000:0.0:1777580315.766323:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725504 00000100:00100000:0.0:1777580315.766326:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725504 00000100:00100000:3.0:1777580315.766328:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 3 00000100:00100000:3.0:1777580315.766334:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725760 00000100:00100000:3.0:1777580315.766335:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725760 00000100:00100000:0.0:1777580315.766341:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 4 00000100:00100000:1.0:1777580315.766358:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725888 00000100:00100000:1.0:1777580315.766363:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725888 00000100:00100000:0.0:1777580315.766391:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726016 00000100:00100000:0.0:1777580315.766395:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726016 00000100:00100000:3.0:1777580315.766908:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 7 00000100:00100000:0.0:1777580315.766922:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836611429802 time 7836611329802 state 0x1 ref 7 00000100:00100000:3.0:1777580315.766936:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836715897849 time 7836715797849 state 0x1 ref 7 00000100:00100000:3.0:1777580315.766953:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283326:x1863919946725120:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.766986:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.767018:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c2d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea50 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767124:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767174:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767188:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767204:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767210:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767216:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767474:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767482:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767489:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767494:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.767499:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767518:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767531:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.767535:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.767542:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767549:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c2de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767568:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767573:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767579:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767583:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.767585:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767589:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.767594:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0249f048900) 00010000:00010000:3.0:1777580315.767596:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.767598:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.769128:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c2e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.769235:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c2d7 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea50 expref: 457 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.769253:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.769255:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.769260:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c2d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea50 expref: 457 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.769269:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:3.0:1777580315.769781:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283326:x1863919946725120:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2829us (4549us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580315.775253:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724189675 time 7836724089675 state 0x1 ref 2 00000100:00100000:0.0:1777580315.775310:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283320:x1863919946724736:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580315.775345:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.775380:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c2ec lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea49 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.775473:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c2ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x808:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea49 expref: 457 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.775494:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c2ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x808:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea49 expref: 457 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.775516:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:0.0:1777580315.775520:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580315.775524:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:0.0:1777580315.775615:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283320:x1863919946724736:12345-192.168.202.9@tcp:101:touch.500 Request processed in 336us (10527us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.775649:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19711 00000100:00100000:0.0:1777580315.775706:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724667666 time 7836724567666 state 0x1 ref 7 00000100:00100000:0.0:1777580315.775718:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283336:x1863919946725248:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.775728:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.775740:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c2f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea57 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.776991:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777014:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777029:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777047:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777053:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777060:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777231:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777241:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777264:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580315.777302:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x801:0x0]: returning size 0 00000004:00200000:0.0:1777580315.777308:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580315.777334:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777350:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777359:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777367:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777375:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777382:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.777386:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777394:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777406:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.777410:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.777414:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777432:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c2fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777452:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777458:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777464:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777469:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.777472:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777478:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777485:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02483f8e600) 00010000:00010000:0.0:1777580315.777487:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.777490:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777495:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c301 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.777578:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724667666 time 7836724567666 state 0x1 ref 7 00000100:00100000:1.0:1777580315.777620:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724189675 time 7836726481331 state 0x0 ref 1 00000100:00100000:1.0:1777580315.777643:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283324:x1863919946724992:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580315.777690:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580315.777710:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c2c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea42 expref: 457 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.777723:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:1.0:1777580315.777732:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580315.777900:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c2f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea57 expref: 457 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777928:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea57 expref: 456 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.777936:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:0.0:1777580315.777938:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.777941:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:0.0:1777580315.778009:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283336:x1863919946725248:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2291us (12763us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.778016:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19714 00000100:00100000:0.0:1777580315.778044:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836727006770 time 7836726906770 state 0x1 ref 6 00000100:00100000:0.0:1777580315.778055:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+455:283343:x1863919946725376:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.778065:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.778075:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c30f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea5e expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778114:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778125:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778162:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778177:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778195:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778203:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778287:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778296:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778303:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580315.778326:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x803:0x0]: returning size 0 00000004:00200000:0.0:1777580315.778330:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580315.778343:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778351:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778358:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778365:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778371:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778387:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.778391:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778396:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778406:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.778408:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.778411:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778416:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c316 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778428:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778434:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778441:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778446:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.778449:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778455:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778473:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02483f8e000) 00010000:00010000:0.0:1777580315.778476:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.778479:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778485:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c31d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778514:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c30f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea5e expref: 457 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778527:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea5e expref: 456 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778535:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa024989ec600) 00010000:00010000:0.0:1777580315.778537:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.778540:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb3e00, rc 0) 00000100:00100000:0.0:1777580315.778573:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283343:x1863919946725376:12345-192.168.202.9@tcp:101:rm.500 Request processed in 518us (13309us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.778582:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19715 00000100:00100000:0.0:1777580315.778610:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836727572588 time 7836727472588 state 0x1 ref 5 00000100:00100000:0.0:1777580315.778623:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+455:283331:x1863919946725504:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.778634:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.778644:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c32b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea65 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778693:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778704:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778713:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778727:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778735:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.778742:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.780620:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19713 00000100:00100000:3.0:1777580315.780706:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836729665190 time 7836729565190 state 0x1 ref 4 00000100:00100000:3.0:1777580315.780733:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+455:283329:x1863919946725760:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580315.780767:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.780809:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c340 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea6c expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.782385:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.782701:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836731658266 time 7836731558266 state 0x1 ref 4 00000100:00100000:2.0:1777580315.782725:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283344:x1863919946726016:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.782757:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.782787:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c347 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea7a expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783046:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783063:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783102:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783118:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783125:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783131:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783275:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783283:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783289:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580315.783319:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x804:0x0]: returning size 0 00000004:00200000:2.0:1777580315.783323:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580315.783344:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783356:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783363:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783380:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783385:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783390:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.783394:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783401:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783412:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.783415:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.783419:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783424:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c34e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783438:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783443:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783448:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783452:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.783460:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783466:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783473:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024aee2df00) 00010000:00010000:2.0:1777580315.783475:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.783477:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783482:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c355 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783514:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c347 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea7a expref: 458 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783529:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea7a expref: 457 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783536:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580315.783539:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580315.783542:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4a00, rc 0) 00000100:00100000:2.0:1777580315.783686:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283344:x1863919946726016:12345-192.168.202.9@tcp:101:rm.500 Request processed in 968us (17380us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.783695:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19718 00000100:00100000:2.0:1777580315.783732:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836731658266 time 7836732594864 state 0x0 ref 3 00000100:00100000:2.0:1777580315.783746:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283341:x1863919946725888:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.783766:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.783775:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c363 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea73 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783819:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783920:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.783929:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784023:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784031:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784038:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784101:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784110:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784119:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580315.784177:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x802:0x0]: returning size 0 00000004:00200000:2.0:1777580315.784192:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580315.784212:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784221:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784230:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784236:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784239:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784242:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784272:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.784274:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784278:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784302:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784304:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784317:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580315.784321:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.784324:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784330:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c36a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784343:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580315.784348:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x800:0x0]: returning size 0 00000004:00200000:0.0:1777580315.784353:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1777580315.784366:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784373:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580315.784376:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784384:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.784390:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784398:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784407:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024aee2d100) 00010000:00010000:2.0:1777580315.784417:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.784420:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784422:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784439:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4c371 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784445:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784454:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784462:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784471:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.784477:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c363 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea73 expref: 458 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784479:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784513:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784528:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea73 expref: 457 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784529:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580315.784540:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.784545:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784547:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa0241785fd00) 00010000:00010000:2.0:1777580315.784565:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.784568:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3c00/0xcb2b2f2f7e4c332 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.784583:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4c00, rc 0) 00010000:00010000:0.0:1777580315.784595:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784604:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784639:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784645:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.784648:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784656:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784666:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024ae57bd00) 00010000:00010000:0.0:1777580315.784669:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.784673:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784679:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50200/0xcb2b2f2f7e4c339 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.784715:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:283341:x1863919946725888:12345-192.168.202.9@tcp:101:rm.500 Request processed in 969us (18428us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.784728:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19719 00010000:00010000:0.0:1777580315.784728:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c32b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea65 expref: 458 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784756:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea65 expref: 456 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.784765:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa024aee2d600) 00000100:00100000:2.0:1777580315.784790:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946725632 00000100:00100000:2.0:1777580315.784809:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946725632 00010000:00010000:1.0:1777580315.785002:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.785015:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.785025:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.785049:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12012 00000100:00100000:2.0:1777580315.785064:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+43:2363:x1863919946725632:12345-192.168.202.9@tcp:2:touch.500 00000004:00010000:1.0:1777580315.785249:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000004f08211 reply state 000000005eacda88 transno 8589950901 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580315.785261:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580315.785371:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:283324:x1863919946724992:12345-192.168.202.9@tcp:36:touch.500 Request processed in 7737us (20172us total) trans 8589950901 rc 0/0 00000100:00100000:1.0:1777580315.785381:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19712 00000100:00100000:1.0:1777580315.785391:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724189675 time 7836726481331 state 0x2 ref 0 00000100:00100000:2.0:1777580315.785551:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+44:2363:x1863919946725632:12345-192.168.202.9@tcp:2:touch.500 Request processed in 487us (19527us total) trans 8589938632 rc 0/0 00000100:00100000:2.0:1777580315.785563:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12012 00000100:00100000:2.0:1777580315.785717:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726272 00000100:00100000:2.0:1777580315.785723:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726272 00000100:00100000:2.0:1777580315.785772:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4221 00000100:00100000:2.0:1777580315.785788:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:283318:x1863919946726272:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:3.0:1777580315.785895:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.785911:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.785938:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.785958:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.785965:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.785972:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786097:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786106:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786114:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580315.786162:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x7ff:0x0]: returning size 0 00000004:00200000:3.0:1777580315.786167:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580315.786194:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786205:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786213:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786233:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786240:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786259:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.786264:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786271:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786347:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.786351:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.786357:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786364:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c38d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.786440:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+459:283318:x1863919946726272:12345-192.168.202.9@tcp:35:touch.500 Request processed in 652us (4057us total) trans 8589950902 rc 0/0 00000100:00100000:2.0:1777580315.786455:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4221 00010000:00010000:3.0:1777580315.786458:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786468:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786475:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786483:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.786494:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786502:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786511:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0249f048700) 00010000:00010000:3.0:1777580315.786513:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.786517:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786522:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c394 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786584:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c340 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea6c expref: 459 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786691:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea6c expref: 458 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.786702:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:3.0:1777580315.786704:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.786707:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1a00, rc 0) 00000100:00100000:3.0:1777580315.786765:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:283329:x1863919946725760:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6042us (20699us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580315.786775:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19717 00010000:00010000:0.0:1777580315.788597:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580315.788610:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51800, rc 0) 00000100:00100000:0.0:1777580315.788700:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283331:x1863919946725504:12345-192.168.202.9@tcp:101:rm.500 Request processed in 10074us (23047us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.788730:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19716 00000100:00100000:0.0:1777580315.788740:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836731658266 time 7836732594864 state 0x2 ref 0 00010000:00010000:0.0:1777580315.788916:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788928:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788935:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788941:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.788947:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788955:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788974:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0249f048b00) 00010000:00010000:0.0:1777580315.788977:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.788981:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.788988:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c2c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.822106:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822158:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822181:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822205:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822273:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822928:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.822964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.823097:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.824458:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727040 00000100:00100000:2.0:1777580315.824477:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727040 00000100:00100000:2.0:1777580315.824550:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4222 00000100:00100000:2.0:1777580315.824564:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+456:283319:x1863919946727040:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.825112:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283319:x1863919946727040:12345-192.168.202.9@tcp:35:touch.500 Request processed in 550us (2903us total) trans 8589950903 rc 0/0 00000100:00100000:2.0:1777580315.825122:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4222 00000100:00100000:2.0:1777580315.825177:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727424 00000100:00100000:2.0:1777580315.825189:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727424 00000100:00100000:2.0:1777580315.825218:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836724189675 time 7836726481331 state 0x0 ref 1 00000100:00100000:2.0:1777580315.825231:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836726581331 time 7836726481331 state 0x1 ref 1 00000100:00100000:2.0:1777580315.825259:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836726581331 time 7836774120739 state 0x0 ref 1 00000100:00100000:2.0:1777580315.825270:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283324:x1863919946727424:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580315.825285:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.825313:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4c3a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaa4 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.825378:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4c3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x809:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaa4 expref: 458 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.825396:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4c3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x809:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaa4 expref: 458 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.825420:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:2.0:1777580315.825423:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580315.825428:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5400, rc 0) 00000100:00100000:2.0:1777580315.825453:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+458:283324:x1863919946727424:12345-192.168.202.9@tcp:101:touch.500 Request processed in 185us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.825461:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19720 00000100:00100000:2.0:1777580315.825466:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836726581331 time 7836774120739 state 0x2 ref 0 00010000:00010000:1.0:1777580315.829830:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829856:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829866:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829873:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580315.829879:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829888:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829916:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:1.0:1777580315.829919:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580315.829926:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580315.829932:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c386 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580315.834131:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726400 00000100:00100000:0.0:1777580315.834172:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726400 00000100:00100000:0.0:1777580315.834240:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726656 00000100:00100000:0.0:1777580315.834349:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726656 00000100:00100000:0.0:1777580315.834447:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726528 00000100:00100000:0.0:1777580315.834452:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726528 00000100:00100000:0.0:1777580315.834480:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946726784 00000100:00100000:0.0:1777580315.834483:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946726784 00000100:00100000:0.0:1777580315.834507:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727168 00000100:00100000:0.0:1777580315.834510:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727168 00000100:00100000:0.0:1777580315.834532:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727296 00000100:00100000:0.0:1777580315.834536:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727296 00000100:00100000:0.0:1777580315.834567:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12013 00000100:00100000:0.0:1777580315.834578:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+36:2363:x1863919946726400:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580315.835053:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2363:x1863919946726400:12345-192.168.202.9@tcp:2:touch.500 Request processed in 475us (12963us total) trans 8589939032 rc 0/0 00000100:00100000:0.0:1777580315.835064:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12013 00000100:00100000:0.0:1777580315.835095:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12014 00000100:00100000:0.0:1777580315.835105:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+46:2364:x1863919946726656:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.835118:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.835171:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea88 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580315.835203:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c0:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:0.0:1777580315.835224:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.835227:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.835238:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 47 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.835961:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.836161:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580315.836203:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727680 00000100:00100000:3.0:1777580315.836214:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727680 00000100:00100000:3.0:1777580315.836254:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836726581331 time 7836774120739 state 0x0 ref 1 00000100:00100000:3.0:1777580315.836268:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836774220739 time 7836774120739 state 0x1 ref 1 00000100:00100000:3.0:1777580315.836293:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836774220739 time 7836785155783 state 0x0 ref 1 00000100:00100000:3.0:1777580315.836368:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+457:283333:x1863919946727680:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.836386:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.836412:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c3b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaab expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.836573:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727808 00000100:00100000:2.0:1777580315.836578:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727808 00000100:00100000:2.0:1777580315.836634:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12015 00000100:00100000:2.0:1777580315.836642:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2364:x1863919946726528:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.836651:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.836666:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea81 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.836681:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580315.836691:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e5:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:3.0:1777580315.836702:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.836707:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.836711:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.836718:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.836719:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.836743:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.836758:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb5a00, rc 0) 00010000:00010000:3.0:1777580315.836825:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.836831:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2364:x1863919946726528:12345-192.168.202.9@tcp:101:rm.500 Request processed in 189us (14647us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.836842:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12015 00010000:00010000:3.0:1777580315.836854:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.836863:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.836869:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12016 00000100:00100000:2.0:1777580315.836879:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2361:x1863919946726784:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.836889:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.836902:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea8f expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580315.836921:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c1:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:2.0:1777580315.836942:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.836943:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.836948:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 48 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.836961:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 48 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.836970:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4400, rc 0) 00000100:00100000:2.0:1777580315.836994:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+48:2361:x1863919946726784:12345-192.168.202.9@tcp:101:rm.500 Request processed in 119us (14720us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.837000:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12016 00000100:00100000:2.0:1777580315.837016:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12017 00000100:00100000:2.0:1777580315.837024:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2363:x1863919946727168:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.837033:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.837046:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea96 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580315.837061:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e7:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:2.0:1777580315.837072:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.837073:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.837078:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.837089:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 38 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.837111:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4e00, rc 0) 00000100:00100000:2.0:1777580315.837173:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2363:x1863919946727168:12345-192.168.202.9@tcp:101:rm.500 Request processed in 112us (14209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.837179:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12017 00000100:00100000:2.0:1777580315.837200:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12018 00000100:00100000:2.0:1777580315.837208:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2362:x1863919946727296:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580315.837216:0:205900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.837228:0:205900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ea9d expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580315.837421:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ea:0x0], index 0: 0 00010000:00010000:0.0:1777580315.837575:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 47 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.837600:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50200, rc 0) 00000100:00100000:0.0:1777580315.837629:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2364:x1863919946726656:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2528us (15470us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.837636:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12014 00000100:00100000:0.0:1777580315.837657:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12019 00000100:00100000:0.0:1777580315.837666:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+37:2364:x1863919946727808:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580315.837674:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580315.837686:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eab2 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580315.837703:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e6:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:0.0:1777580315.837716:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.837718:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580315.837722:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 38 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.837733:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 38 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.837741:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51c00, rc 0) 00000100:00100000:0.0:1777580315.837762:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2364:x1863919946727808:12345-192.168.202.9@tcp:101:rm.500 Request processed in 99us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580315.837768:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12019 00010000:00010000:3.0:1777580315.838056:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c3e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838066:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838073:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838108:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838114:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838119:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838126:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.838132:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838261:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838307:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.838312:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.838319:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838327:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.838355:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e1a267cb reply state 00000000ba2bb222 transno 8589950904 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.838434:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.838480:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c3b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaab expref: 460 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838495:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaab expref: 459 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.838501:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0249f048900) 00010000:00010000:3.0:1777580315.838503:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.838505:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030e00, rc 0) 00002000:00010000:2.0:1777580315.838858:0:205900:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c2:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:2.0:1777580315.838882:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.838885:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580315.838892:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 47 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.838907:0:205900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 47 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.838918:0:205900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4000, rc 0) 00000100:00100000:2.0:1777580315.838975:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2362:x1863919946727296:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1768us (15877us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.838984:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12018 00000100:00100000:3.0:1777580315.846190:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:283333:x1863919946727680:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9865us (10211us total) trans 8589950904 rc 0/0 00000100:00100000:3.0:1777580315.846207:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19721 00000100:00100000:3.0:1777580315.846217:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836774220739 time 7836785155783 state 0x2 ref 0 00000100:00100000:0.0:1777580315.847012:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.847205:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.847352:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946727936 00000100:00100000:0.0:1777580315.847364:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946727936 00000100:00100000:0.0:1777580315.847423:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12020 00000100:00100000:0.0:1777580315.847434:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+47:2362:x1863919946727936:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580315.847847:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+48:2362:x1863919946727936:12345-192.168.202.9@tcp:2:touch.500 Request processed in 413us (837us total) trans 8589938633 rc 0/0 00000100:00100000:0.0:1777580315.847856:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12020 00000100:00100000:2.0:1777580315.851496:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946728192 00000100:00100000:2.0:1777580315.851520:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946728192 00000100:00100000:2.0:1777580315.851592:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4223 00000100:00100000:2.0:1777580315.851605:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:283320:x1863919946728192:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.852101:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+461:283320:x1863919946728192:12345-192.168.202.9@tcp:35:touch.500 Request processed in 498us (4895us total) trans 8589950905 rc 0/0 00000100:00100000:2.0:1777580315.852112:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4223 00010000:00010000:0.0:1777580315.855105:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855129:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855159:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855166:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.855173:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855182:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855202:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0249f048700) 00010000:00010000:0.0:1777580315.855205:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.855211:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.855218:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c3c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.863536:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.863593:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.863696:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946728704 00000100:00100000:2.0:1777580315.863709:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946728704 00000100:00100000:2.0:1777580315.863759:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836774220739 time 7836785155783 state 0x0 ref 1 00000100:00100000:2.0:1777580315.864334:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836785255783 time 7836785155783 state 0x1 ref 1 00000100:00100000:2.0:1777580315.864366:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946728448 00000100:00100000:2.0:1777580315.864372:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946728448 00000100:00100000:3.0:1777580315.869237:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836785255783 time 7836818090199 state 0x0 ref 1 00000100:00100000:3.0:1777580315.869286:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+460:283335:x1863919946728704:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.869320:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.869346:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c3f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eab9 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869546:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869564:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869580:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869598:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869605:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.869612:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.871589:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836818190199 time 7836818090199 state 0x1 ref 2 00000100:00100000:2.0:1777580315.871646:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836818190199 time 7836820507895 state 0x0 ref 2 00000100:00100000:2.0:1777580315.871668:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+462:283333:x1863919946728448:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580315.871744:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580315.871780:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c3e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaab expref: 462 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.871819:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0249f048900) 00010000:00010000:2.0:1777580315.871836:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580315.871937:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.871965:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.871978:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580315.872195:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a394054e reply state 000000006e4e0646 transno 8589950906 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.872207:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580315.872360:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:283333:x1863919946728448:12345-192.168.202.9@tcp:36:touch.500 Request processed in 700us (8764us total) trans 8589950906 rc 0/0 00000100:00100000:2.0:1777580315.872369:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19723 00000100:00100000:2.0:1777580315.872630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.872664:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946728960 00000100:00100000:2.0:1777580315.872675:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946728960 00000100:00100000:2.0:1777580315.872716:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4224 00000100:00100000:2.0:1777580315.872726:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:283324:x1863919946728960:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.873057:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:283324:x1863919946728960:12345-192.168.202.9@tcp:35:touch.500 Request processed in 332us (427us total) trans 8589950907 rc 0/0 00000100:00100000:2.0:1777580315.873067:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4224 00010000:00010000:2.0:1777580315.886570:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886596:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886606:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886622:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580315.886629:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886638:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886660:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580315.886663:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580315.886670:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.886677:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c40b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.890984:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.891076:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946729088 00000100:00100000:2.0:1777580315.891088:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946729088 00000100:00100000:2.0:1777580315.891170:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836820607895 time 7836820507895 state 0x1 ref 2 00000100:00100000:2.0:1777580315.891200:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836820607895 time 7836840060737 state 0x0 ref 2 00000100:00100000:2.0:1777580315.891214:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+463:283333:x1863919946729088:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580315.891666:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580315.891703:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c412 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eac0 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.891789:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac0 expref: 464 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.891839:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac0 expref: 464 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580315.891863:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0241785f000) 00010000:00010000:2.0:1777580315.891868:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580315.891872:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:2.0:1777580315.891953:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+464:283333:x1863919946729088:12345-192.168.202.9@tcp:101:touch.500 Request processed in 741us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580315.891963:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19724 00000004:00080000:3.0:1777580315.893839:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c6:0x0], index 1: 0 00010000:00010000:3.0:1777580315.894473:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c419 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894495:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c419 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894542:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c419 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894607:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894616:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894624:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894632:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580315.894638:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894648:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894664:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580315.894668:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580315.894673:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.894680:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c3fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580315.894697:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000045eb72fe reply state 00000000753dff19 transno 8589950908 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.894709:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580315.895988:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c3f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab9 expref: 465 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.896036:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c419 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab9 expref: 464 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.896045:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048500) 00010000:00010000:3.0:1777580315.896049:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580315.896051:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:3.0:1777580315.896172:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:283335:x1863919946728704:12345-192.168.202.9@tcp:101:touch.500 Request processed in 26901us (32648us total) trans 8589950908 rc 0/0 00000100:00100000:3.0:1777580315.896184:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19722 00000100:00100000:3.0:1777580315.896194:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836820607895 time 7836840060737 state 0x2 ref 0 00000100:00100000:2.0:1777580315.905736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580315.908440:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946729216 00000100:00100000:0.0:1777580315.908462:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946729216 00000100:00100000:0.0:1777580315.908546:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12021 00000100:00100000:0.0:1777580315.908559:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+38:2363:x1863919946729216:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580315.909085:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+39:2363:x1863919946729216:12345-192.168.202.9@tcp:2:touch.500 Request processed in 527us (3363us total) trans 8589939033 rc 0/0 00000100:00100000:0.0:1777580315.909094:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12021 00000100:00100000:2.0:1777580315.913888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.913925:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580315.920023:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920050:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920061:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920069:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580315.920076:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920087:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920110:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0249f048a00) 00010000:00010000:0.0:1777580315.920114:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580315.920120:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580315.920127:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c404 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580315.955055:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946729728 00000100:00100000:3.0:1777580315.955076:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946729728 00000100:00100000:3.0:1777580315.955301:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836820607895 time 7836840060737 state 0x0 ref 1 00000100:00100000:3.0:1777580315.955319:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836840160737 time 7836840060737 state 0x1 ref 1 00000100:00100000:3.0:1777580315.955357:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946729472 00000100:00100000:3.0:1777580315.955361:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946729472 00000100:00100000:3.0:1777580315.955379:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836840160737 time 7836840060737 state 0x1 ref 2 00000100:00100000:3.0:1777580315.955401:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836904363923 time 7836904263923 state 0x1 ref 2 00000100:00100000:3.0:1777580315.955421:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+465:283334:x1863919946729728:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580315.955460:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580315.955490:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c427 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eac7 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955686:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955705:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955719:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955738:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955745:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580315.955751:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580315.959508:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580315.959558:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946729984 00000100:00100000:2.0:1777580315.959572:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946729984 00000100:00100000:2.0:1777580315.959637:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4225 00000100:00100000:2.0:1777580315.959649:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283333:x1863919946729984:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580315.960188:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283333:x1863919946729984:12345-192.168.202.9@tcp:35:touch.500 Request processed in 540us (694us total) trans 8589950909 rc 0/0 00000100:00100000:2.0:1777580315.960199:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4225 00000001:00080000:1.0:1777580315.961845:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938629 is committed 00000001:00080000:1.0:1777580315.961867:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938619 is committed 00000001:00080000:1.0:1777580315.961889:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938599 is committed 00000001:00080000:1.0:1777580315.961960:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938610 is committed 00000001:00080000:1.0:1777580315.961997:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938631 is committed 00000001:00080000:1.0:1777580315.962078:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938622 is committed 00000004:00080000:3.0:1777580316.039632:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15eb:0x0], index 0: 0 00010000:00010000:3.0:1777580316.042715:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c43c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.042746:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c43c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046460:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c43c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046605:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046637:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046645:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046651:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.046657:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046665:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046686:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.046690:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.046696:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.046703:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c42e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.046723:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000000ee46e9 reply state 000000006cbc9637 transno 8589950910 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.046733:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580316.047079:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c427 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac7 expref: 469 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.047104:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c43c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac7 expref: 468 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.047128:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa0249f048300) 00010000:00010000:3.0:1777580316.047131:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.047154:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997e600, rc 0) 00000100:00100000:3.0:1777580316.051632:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+469:283334:x1863919946729728:12345-192.168.202.9@tcp:101:touch.500 Request processed in 96200us (137742us total) trans 8589950910 rc 0/0 00000100:00100000:3.0:1777580316.051648:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19725 00000100:00100000:3.0:1777580316.051724:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836904363923 time 7837000583359 state 0x0 ref 1 00000100:00100000:3.0:1777580316.051760:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283335:x1863919946729472:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580316.051855:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580316.051889:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c419 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab9 expref: 468 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.051918:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048500) 00010000:00010000:3.0:1777580316.051930:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.062911:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.062946:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.062965:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.066969:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e3f7c7f0 reply state 0000000045958782 transno 8589950911 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.067015:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.068777:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+469:283335:x1863919946729472:12345-192.168.202.9@tcp:36:touch.500 Request processed in 16818us (154630us total) trans 8589950911 rc 0/0 00000100:00100000:3.0:1777580316.068803:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19726 00000100:00100000:3.0:1777580316.068815:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836904363923 time 7837000583359 state 0x2 ref 0 00000100:00080000:3.0:1777580316.070046:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580316.077088:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.078370:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.078418:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078431:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078447:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078454:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.078460:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078469:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078489:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0249f048e00) 00010000:00010000:2.0:1777580316.078492:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.078497:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078504:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c435 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078546:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078553:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078558:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078564:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.078566:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078587:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078596:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048000) 00010000:00010000:2.0:1777580316.078599:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.078602:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.078607:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c44a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.078642:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730240 00000100:00100000:2.0:1777580316.078654:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730240 00000100:00100000:2.0:1777580316.078741:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836904363923 time 7837000583359 state 0x0 ref 1 00000100:00100000:2.0:1777580316.078755:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837000683359 time 7837000583359 state 0x1 ref 1 00000100:00100000:2.0:1777580316.078774:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730368 00000100:00100000:2.0:1777580316.078778:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730368 00000100:00100000:2.0:1777580316.078790:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836731658266 time 7836732594864 state 0x0 ref 1 00000100:00100000:2.0:1777580316.080066:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836732694864 time 7836732594864 state 0x1 ref 1 00000100:00100000:2.0:1777580316.087599:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836732694864 time 7837036448158 state 0x0 ref 1 00000100:00100000:2.0:1777580316.087639:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283346:x1863919946730368:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.087669:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.087699:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c451 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eace expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089715:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089745:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089774:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089805:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089813:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089820:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089969:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089977:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.089984:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580316.090019:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x805:0x0]: returning size 0 00000004:00200000:2.0:1777580316.090023:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580316.090050:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090090:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090099:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090105:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090113:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090119:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.090124:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090131:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090167:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.090170:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.090176:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090182:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c458 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090194:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090198:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090211:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090216:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.090219:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090225:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090233:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0241785f800) 00010000:00010000:2.0:1777580316.090235:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.090238:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090428:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c45f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090477:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c451 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eace expref: 470 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090494:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eace expref: 469 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.090503:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.090505:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580316.090509:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc7000, rc 0) 00000100:00100000:2.0:1777580316.090610:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+469:283346:x1863919946730368:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2986us (12245us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.090630:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19728 00000100:00100000:2.0:1777580316.090640:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836732694864 time 7837036448158 state 0x2 ref 0 00000100:00100000:2.0:1777580316.090695:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837000683359 time 7837039557212 state 0x0 ref 1 00000100:00100000:2.0:1777580316.090715:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283334:x1863919946730240:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580316.091027:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580316.091048:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c43c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac7 expref: 468 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.091062:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa0249f048300) 00010000:00010000:2.0:1777580316.091075:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580316.093082:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093262:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093284:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093305:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093324:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093348:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.093374:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730496 00000100:00100000:2.0:1777580316.093386:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730496 00000100:00100000:2.0:1777580316.093441:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837039657212 time 7837039557212 state 0x1 ref 2 00000100:00100000:2.0:1777580316.093459:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730624 00000100:00100000:2.0:1777580316.093462:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730624 00000100:00100000:2.0:1777580316.093474:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7836732694864 time 7837036448158 state 0x0 ref 1 00000100:00100000:2.0:1777580316.093481:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837036548158 time 7837036448158 state 0x1 ref 1 00000100:00100000:2.0:1777580316.093509:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730752 00000100:00100000:2.0:1777580316.093512:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730752 00000100:00100000:2.0:1777580316.093524:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837036548158 time 7837036448158 state 0x1 ref 2 00000100:00100000:2.0:1777580316.093532:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946730880 00000100:00100000:2.0:1777580316.093533:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946730880 00000100:00100000:2.0:1777580316.093543:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837036548158 time 7837036448158 state 0x1 ref 3 00000100:00100000:2.0:1777580316.093550:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731008 00000100:00100000:2.0:1777580316.093552:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731008 00000100:00100000:2.0:1777580316.093561:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837036548158 time 7837036448158 state 0x1 ref 4 00000100:00100000:2.0:1777580316.093569:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731136 00000100:00100000:2.0:1777580316.093571:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731136 00000100:00100000:2.0:1777580316.093581:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837036548158 time 7837036448158 state 0x1 ref 5 00000100:00100000:2.0:1777580316.093593:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837042556358 time 7837042456358 state 0x1 ref 5 00000100:00100000:2.0:1777580316.093605:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+473:283348:x1863919946730624:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.093636:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.093663:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c46d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eadc expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093748:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093767:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093782:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093821:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093830:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093837:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093985:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.093995:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094003:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580316.094040:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x806:0x0]: returning size 0 00000004:00200000:2.0:1777580316.094044:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580316.094069:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094083:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094093:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094100:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094117:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094124:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.094129:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094165:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094179:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.094183:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.094187:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094194:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c474 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094210:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094216:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094223:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094230:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:3.0:1777580316.094232:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837039657212 time 7837043090179 state 0x0 ref 2 00010000:00010000:2.0:1777580316.094234:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.094261:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283335:x1863919946730496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580316.094264:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.094275:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.094276:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580316.094280:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.094283:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094290:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c47b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.094293:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c489 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ead5 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094327:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c46d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eadc expref: 476 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094342:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eadc expref: 475 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094349:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580316.094352:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580316.094354:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0c00, rc 0) 00000100:00100000:2.0:1777580316.094421:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283348:x1863919946730624:12345-192.168.202.9@tcp:101:rm.500 Request processed in 818us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.094429:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19730 00000100:00100000:2.0:1777580316.094455:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837043418208 time 7837043318208 state 0x1 ref 4 00000100:00100000:2.0:1777580316.094465:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283350:x1863919946730752:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.094472:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.094486:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c490 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eae3 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094518:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094526:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094533:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094547:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094552:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094558:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094610:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094618:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094625:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580316.094644:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x807:0x0]: returning size 0 00000004:00200000:2.0:1777580316.094647:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580316.094656:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094671:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094677:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094683:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094689:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094694:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.094696:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094702:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094709:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.094712:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.094715:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094721:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c497 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094732:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.094735:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c489 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ead5 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094742:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.094754:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c489 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ead5 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094756:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094763:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.094766:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094771:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094779:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02493bbdf00) 00010000:00010000:2.0:1777580316.094781:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.094784:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.094790:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c49e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.095460:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048900) 00010000:00010000:3.0:1777580316.095463:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580316.095467:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997f400, rc 0) 00000100:00100000:3.0:1777580316.095525:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283335:x1863919946730496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1271us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.095534:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19729 00000100:00100000:3.0:1777580316.095578:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837044539261 time 7837044439261 state 0x1 ref 4 00000100:00100000:3.0:1777580316.096057:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283352:x1863919946730880:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.096128:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.096180:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c4ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaea expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096245:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096261:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096272:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096289:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096295:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096302:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096535:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096544:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.096552:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580316.098232:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x808:0x0]: returning size 0 00000004:00200000:3.0:1777580316.098244:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580316.098289:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098311:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098325:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098333:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098341:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098348:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.098353:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098362:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098379:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.098383:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.098388:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098396:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c4b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098436:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098443:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098449:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098456:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.098459:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098466:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098477:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0249f048500) 00010000:00010000:3.0:1777580316.098480:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.098484:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098490:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c4ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098552:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c4ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaea expref: 476 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098574:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaea expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.098612:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:3.0:1777580316.098615:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.098619:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:3.0:1777580316.098701:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283352:x1863919946730880:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3107us (5391us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.098713:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19732 00000100:00100000:3.0:1777580316.099289:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837048245800 time 7837048145800 state 0x1 ref 3 00000100:00100000:3.0:1777580316.099317:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283355:x1863919946731008:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.099342:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.099366:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c4c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaf1 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099446:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099461:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099474:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099494:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099502:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099528:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099698:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099710:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.099720:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580316.099752:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x809:0x0]: returning size 0 00000004:00200000:3.0:1777580316.099757:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580316.100078:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100092:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100099:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100105:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100112:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100119:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.100122:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100164:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100178:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.100182:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.100186:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100192:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c4cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100213:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100219:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100226:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100231:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.100234:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100240:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100247:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0249f048b00) 00010000:00010000:3.0:1777580316.100249:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.100252:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100264:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030200/0xcb2b2f2f7e4c4d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100300:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c4c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf1 expref: 476 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100313:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf1 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100320:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:3.0:1777580316.100322:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.100325:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:3.0:1777580316.100387:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283355:x1863919946731008:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1083us (7060us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.100395:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19733 00000100:00100000:3.0:1777580316.100433:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837048245800 time 7837049294812 state 0x0 ref 2 00000100:00100000:3.0:1777580316.100448:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283367:x1863919946731136:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.100459:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.100469:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c4e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaf8 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100508:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100518:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100537:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100554:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100561:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100568:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100665:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100673:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100680:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580316.100703:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x80a:0x0]: returning size 0 00000004:00200000:3.0:1777580316.100705:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580316.100717:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100725:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100730:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100745:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100750:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100755:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.100770:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100776:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100784:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.100787:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.100790:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100803:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c4eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100815:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100820:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100833:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100837:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.100847:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100853:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100860:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0249f048d00) 00010000:00010000:3.0:1777580316.100863:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.100865:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100871:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c4f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100895:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c4e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf8 expref: 476 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100906:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf8 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.100912:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0241785f000) 00010000:00010000:3.0:1777580316.100914:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.100917:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f149600, rc 0) 00000100:00100000:3.0:1777580316.100945:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283367:x1863919946731136:12345-192.168.202.9@tcp:101:rm.500 Request processed in 501us (7596us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.100953:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19734 00010000:00010000:1.0:1777580316.102067:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.102091:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.102104:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.102314:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f6bfa5c5 reply state 0000000097096f35 transno 8589950912 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.102325:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580316.102447:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283334:x1863919946730240:12345-192.168.202.9@tcp:36:touch.500 Request processed in 11737us (25367us total) trans 8589950912 rc 0/0 00000100:00100000:1.0:1777580316.102457:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19727 00000100:00100000:1.0:1777580316.102464:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837039657212 time 7837043090179 state 0x2 ref 0 00010000:00010000:2.0:1777580316.107388:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c490 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eae3 expref: 476 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.107413:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eae3 expref: 475 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.107423:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa02490544700) 00010000:00010000:2.0:1777580316.107426:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580316.107431:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:2.0:1777580316.107933:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283350:x1863919946730752:12345-192.168.202.9@tcp:101:rm.500 Request processed in 13465us (14643us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.107966:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19731 00000100:00100000:2.0:1777580316.107977:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837048245800 time 7837049294812 state 0x2 ref 0 00000100:00100000:1.0:1777580316.113756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.114453:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731264 00000100:00100000:2.0:1777580316.114468:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731264 00000100:00100000:2.0:1777580316.114555:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12022 00000100:00100000:2.0:1777580316.114568:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946731264:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.114593:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.114624:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eaff expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580316.114658:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c3:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:2.0:1777580316.114687:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580316.114690:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580316.114701:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 29 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.114724:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 29 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.114741:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7400, rc 0) 00000100:00100000:1.0:1777580316.114922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000001:00080000:0.0:1777580316.115197:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939029 is committed 00000001:00080000:0.0:1777580316.115213:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939019 is committed 00000100:00100000:2.0:1777580316.115538:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946731264:12345-192.168.202.9@tcp:101:rm.500 Request processed in 971us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.115549:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12022 00000100:00100000:2.0:1777580316.115577:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731392 00000100:00100000:2.0:1777580316.115583:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731392 00000100:00100000:2.0:1777580316.115637:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12023 00000100:00100000:2.0:1777580316.115646:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2364:x1863919946731392:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580316.116194:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2364:x1863919946731392:12345-192.168.202.9@tcp:2:touch.500 Request processed in 547us (1271us total) trans 8589938634 rc 0/0 00000100:00100000:2.0:1777580316.116203:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12023 00000100:00080000:2.0:1777580316.116230:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1777580316.116489:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589938997 is committed 00000001:00080000:0.0:1777580316.116553:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939030 is committed 00000001:00080000:0.0:1777580316.116562:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939005 is committed 00000001:00080000:0.0:1777580316.116595:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939026 is committed 00000001:00080000:0.0:1777580316.116607:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939008 is committed 00000001:00080000:0.0:1777580316.116646:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939027 is committed 00000100:00100000:2.0:1777580316.124338:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.124388:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.124442:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.125025:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.125595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.125644:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125662:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125672:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125679:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.125686:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125696:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125722:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa0248e788600) 00010000:00010000:2.0:1777580316.125727:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.125753:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.125761:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c500 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.126162:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731648 00000100:00100000:1.0:1777580316.126178:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731648 00000100:00100000:1.0:1777580316.126236:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731904 00000100:00100000:1.0:1777580316.126239:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731904 00000100:00100000:1.0:1777580316.126258:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731776 00000100:00100000:1.0:1777580316.126261:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731776 00000100:00100000:1.0:1777580316.126280:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946731520 00000100:00100000:1.0:1777580316.126283:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946731520 00000100:00100000:1.0:1777580316.126310:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12024 00000100:00100000:1.0:1777580316.126334:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946731648:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580316.126361:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.126458:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb0d expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.126511:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732032 00000100:00100000:2.0:1777580316.126516:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732032 00002000:00010000:1.0:1777580316.126531:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e8:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00000100:00100000:2.0:1777580316.126549:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837039657212 time 7837043090179 state 0x0 ref 1 00010000:00010000:1.0:1777580316.126563:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1777580316.126565:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837043190179 time 7837043090179 state 0x1 ref 1 00010000:00010000:1.0:1777580316.126567:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.126581:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.126593:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837043190179 time 7837075454775 state 0x0 ref 1 00000100:00100000:2.0:1777580316.126608:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283334:x1863919946732032:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580316.126608:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.126628:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838800, rc 0) 00010000:00010000:2.0:1777580316.126630:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.126648:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c515 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb22 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.126709:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946731648:12345-192.168.202.9@tcp:101:rm.500 Request processed in 379us (2389us total) trans 0 rc 0/0 00010000:00010000:2.0:1777580316.126717:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c515 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb22 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.126721:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12024 00010000:00010000:2.0:1777580316.126736:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c515 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb22 expref: 475 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.126751:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12025 00010000:00010000:2.0:1777580316.126753:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:2.0:1777580316.126757:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1777580316.126761:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946731904:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.126762:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:2.0:1777580316.126788:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283334:x1863919946732032:12345-192.168.202.9@tcp:101:touch.500 Request processed in 184us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.126815:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19735 00000100:00100000:2.0:1777580316.126820:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837043190179 time 7837075454775 state 0x2 ref 0 00010000:00010000:1.0:1777580316.126877:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.126891:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb1b expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580316.126910:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ea:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:1.0:1777580316.126921:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.126931:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.126936:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.126949:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.126959:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839e00, rc 0) 00000100:00100000:1.0:1777580316.126983:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946731904:12345-192.168.202.9@tcp:101:rm.500 Request processed in 225us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580316.126989:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12025 00000100:00100000:1.0:1777580316.127003:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12026 00000100:00100000:1.0:1777580316.127010:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946731776:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580316.127019:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.127032:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb14 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580316.127049:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c5:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:1.0:1777580316.127061:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.127062:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.127067:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 31 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.127079:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 31 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.127100:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838200, rc 0) 00000100:00100000:1.0:1777580316.127121:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946731776:12345-192.168.202.9@tcp:101:rm.500 Request processed in 112us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580316.127127:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12026 00000100:00100000:1.0:1777580316.127176:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12027 00000100:00100000:1.0:1777580316.127185:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2363:x1863919946731520:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580316.127194:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.127205:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb06 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580316.127219:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15e9:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:1.0:1777580316.127230:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.127232:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.127237:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.127248:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 29 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.127258:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838e00, rc 0) 00000100:00100000:1.0:1777580316.127282:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2363:x1863919946731520:12345-192.168.202.9@tcp:101:rm.500 Request processed in 99us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580316.127289:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12027 00000100:00100000:2.0:1777580316.127471:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.127567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.127707:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732416 00000100:00100000:2.0:1777580316.127715:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732416 00000100:00100000:2.0:1777580316.127744:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837048245800 time 7837049294812 state 0x0 ref 1 00000100:00100000:2.0:1777580316.127756:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837049394812 time 7837049294812 state 0x1 ref 1 00000100:00100000:2.0:1777580316.127779:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837049394812 time 7837076641922 state 0x0 ref 1 00000100:00100000:2.0:1777580316.127791:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283346:x1863919946732416:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.127950:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.127976:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4c466 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x805:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eace expref: 475 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.127999:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838c00/0xcb2b2f2f7e4c228 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x805:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea1f expref: 474 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128011:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.128023:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.128060:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128082:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128110:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128129:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128182:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128189:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128352:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128361:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.128368:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.128637:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732160 00000100:00100000:0.0:1777580316.128646:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732160 00000100:00100000:0.0:1777580316.128697:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12028 00000100:00100000:0.0:1777580316.128708:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946732160:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580316.128722:0:205896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.128740:0:205896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb29 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580316.128778:0:205896:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c4:0x0] initial LVB size: 0, mtime: 0x69f3b91a, atime: 0x69f3b91a, ctime: 0x69f3b91a, blocks: 0x1 00010000:00010000:0.0:1777580316.128806:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580316.128809:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580316.128818:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 32 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.128835:0:205896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 32 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.128849:0:205896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb3c00, rc 0) 00000100:00100000:0.0:1777580316.128922:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946732160:12345-192.168.202.9@tcp:101:rm.500 Request processed in 216us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580316.128929:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12028 00000040:00080000:2.0:1777580316.130615:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1887, 64 off128960 00000004:00080000:2.0:1777580316.130634:0:188495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7837079498874ns, next at 7838079495237ns, rc = 0 00010000:00010000:2.0:1777580316.131439:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131463:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131479:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131505:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131511:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131517:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131543:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.131575:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131582:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131588:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131595:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.131600:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131608:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131624:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580316.131627:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.131634:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131652:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4c53f lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x805:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131679:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131685:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131691:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131696:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.131700:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131706:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131715:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.131718:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.131721:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.131727:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c531 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.131740:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004eecef3d reply state 00000000a33bc53d transno 8589950913 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.131752:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.131893:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283346:x1863919946732416:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4096us (4317us total) trans 8589950913 rc 0/0 00000100:00100000:2.0:1777580316.131904:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19736 00000100:00100000:2.0:1777580316.131913:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837049394812 time 7837076641922 state 0x2 ref 0 00010000:00010000:3.0:1777580316.132976:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580316.132989:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.133015:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580316.133019:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.133026:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.133043:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x805:0x0].0x0 (ffffa0241785f800) 00010000:00010000:3.0:1777580316.133046:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580316.133050:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.133056:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4c54d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x805:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.133084:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580316.133086:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580316.133087:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580316.133285:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.134678:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732672 00000100:00100000:2.0:1777580316.134694:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732672 00000100:00100000:2.0:1777580316.134874:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4226 00000100:00100000:2.0:1777580316.134888:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283335:x1863919946732672:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580316.136171:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283335:x1863919946732672:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1248us (2850us total) trans 8589950914 rc 0/0 00000100:00100000:2.0:1777580316.136186:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4226 00000100:00100000:2.0:1777580316.137479:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.137896:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732800 00000100:00100000:3.0:1777580316.137912:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732800 00000100:00100000:3.0:1777580316.137991:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12029 00000100:00100000:3.0:1777580316.138006:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2362:x1863919946732800:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580316.140655:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946732800:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2640us (3171us total) trans 8589939034 rc 0/0 00000100:00100000:3.0:1777580316.140670:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12029 00000100:00100000:2.0:1777580316.150202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.150316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.150349:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150364:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150373:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150380:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.150386:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150394:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150431:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580316.150434:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.150440:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150447:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c538 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.150501:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946732928 00000100:00100000:2.0:1777580316.150513:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946732928 00000100:00100000:2.0:1777580316.150557:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837049394812 time 7837076641922 state 0x0 ref 1 00000100:00100000:2.0:1777580316.150570:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837076741922 time 7837076641922 state 0x1 ref 1 00000100:00100000:2.0:1777580316.150596:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837076741922 time 7837099457754 state 0x0 ref 1 00000100:00100000:2.0:1777580316.150609:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283326:x1863919946732928:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.150641:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.150659:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c554 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb30 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150749:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150767:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150780:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150823:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150832:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150840:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150944:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150951:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150957:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150963:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.150966:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150972:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150980:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.150983:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.150986:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.150991:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c55b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151009:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151016:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151023:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151028:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.151031:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151036:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151045:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.151047:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.151050:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151056:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c562 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151094:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c554 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb30 expref: 476 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151105:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.151108:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.151119:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c554 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb30 expref: 476 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.151129:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fe00, rc 0) 00000100:00100000:2.0:1777580316.151228:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283326:x1863919946732928:12345-192.168.202.9@tcp:101:rm.500 Request processed in 621us (1041us total) trans 0 rc 301/301 00000100:00100000:2.0:1777580316.151237:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19737 00000100:00100000:2.0:1777580316.151243:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837076741922 time 7837099457754 state 0x2 ref 0 00000100:00100000:2.0:1777580316.151281:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946733184 00000100:00100000:2.0:1777580316.151286:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946733184 00000100:00100000:2.0:1777580316.151318:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4227 00000100:00100000:2.0:1777580316.151326:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283334:x1863919946733184:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580316.151667:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283334:x1863919946733184:12345-192.168.202.9@tcp:35:touch.500 Request processed in 340us (1350us total) trans 8589950915 rc 0/0 00000100:00100000:2.0:1777580316.151677:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4227 00000100:00100000:3.0:1777580316.166647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.167332:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946733312 00000100:00100000:2.0:1777580316.167348:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946733312 00000100:00100000:2.0:1777580316.167402:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837076741922 time 7837099457754 state 0x0 ref 1 00000100:00100000:2.0:1777580316.167418:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837099557754 time 7837099457754 state 0x1 ref 1 00000100:00100000:2.0:1777580316.167453:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837099557754 time 7837116314294 state 0x0 ref 1 00000100:00100000:2.0:1777580316.167468:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283377:x1863919946733312:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580316.167501:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.167527:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c569 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb37 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167647:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167666:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167680:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167695:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167701:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.167707:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172572:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172612:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172630:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580316.172706:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x80c:0x0]: returning size 0 00000004:00200000:2.0:1777580316.172712:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580316.172746:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172818:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172841:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172849:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172857:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172864:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.172869:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172877:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172893:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.172896:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.172902:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172909:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c570 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172925:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172932:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172946:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172951:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.172954:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172961:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172969:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.172972:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.172976:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.172981:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c577 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.173044:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c569 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb37 expref: 478 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.173060:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb37 expref: 477 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.173080:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:2.0:1777580316.173083:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580316.173086:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997ea00, rc 0) 00000100:00100000:2.0:1777580316.173216:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+477:283377:x1863919946733312:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5750us (6584us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.173238:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19738 00000100:00100000:2.0:1777580316.173248:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837099557754 time 7837116314294 state 0x2 ref 0 00000100:00100000:2.0:1777580316.212362:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.212638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.212687:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946733696 00000100:00100000:2.0:1777580316.212700:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946733696 00000100:00100000:2.0:1777580316.212749:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837099557754 time 7837116314294 state 0x0 ref 1 00000100:00100000:2.0:1777580316.213235:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837116414294 time 7837116314294 state 0x1 ref 1 00000100:00100000:2.0:1777580316.213273:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837116414294 time 7837162134175 state 0x0 ref 1 00000100:00100000:2.0:1777580316.213291:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+477:283336:x1863919946733696:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.213370:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.213407:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c308 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x801:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea57 expref: 477 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.213438:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c068 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x801:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9b6 expref: 476 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.213452:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:2.0:1777580316.213465:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.213502:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.213520:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.213539:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946733440 00010000:00010000:2.0:1777580316.213558:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.213558:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946733440 00010000:00010000:2.0:1777580316.213582:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.213590:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.213598:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.213608:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12030 00000100:00100000:1.0:1777580316.213618:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2363:x1863919946733440:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580316.213630:0:189456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.213651:0:189456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb3e expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580316.213681:0:189456:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15eb:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:1.0:1777580316.213702:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.213705:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580316.213714:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 31 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.213732:0:189456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 31 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.213747:0:189456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838c00, rc 0) 00010000:00010000:2.0:1777580316.213756:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.213846:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2363:x1863919946733440:12345-192.168.202.9@tcp:101:rm.500 Request processed in 228us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580316.213853:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12030 00010000:00010000:2.0:1777580316.214477:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.214488:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.215173:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1888, 64 off129024 00010000:00010000:2.0:1777580316.215254:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215266:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215276:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215283:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215299:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215307:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215328:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.215359:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215365:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215372:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215377:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.215382:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215391:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215404:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580316.215408:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.215412:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215419:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c59a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x801:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215451:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215458:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215463:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215469:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.215472:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215478:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215486:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.215489:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.215491:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215497:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c585 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.215507:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002b02edd9 reply state 000000002e211d03 transno 8589950916 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.215517:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.215603:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+477:283336:x1863919946733696:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2314us (3250us total) trans 8589950916 rc 0/0 00000100:00100000:2.0:1777580316.215615:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19739 00000100:00100000:2.0:1777580316.215629:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837116414294 time 7837162134175 state 0x2 ref 0 00010000:00010000:2.0:1777580316.215675:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.215683:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215690:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.215694:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215700:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215710:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x801:0x0].0x0 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580316.215712:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.215715:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215722:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x801:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.215738:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.215740:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.215743:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.228621:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228645:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228653:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228680:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.228687:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228696:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228719:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.228723:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.228729:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.228737:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c58c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.231268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.231506:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946733952 00000100:00100000:3.0:1777580316.231535:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946733952 00000100:00100000:3.0:1777580316.231589:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837116414294 time 7837162134175 state 0x0 ref 1 00000100:00100000:3.0:1777580316.231606:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837162234175 time 7837162134175 state 0x1 ref 1 00000100:00100000:3.0:1777580316.231649:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837162234175 time 7837180510434 state 0x0 ref 1 00000100:00100000:3.0:1777580316.231663:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283343:x1863919946733952:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580316.231748:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580316.231867:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c324 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x803:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea5e expref: 476 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.231902:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c179 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x803:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9ee expref: 475 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.231915:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580316.231927:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.231960:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.231977:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.231989:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232008:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232016:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232036:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232206:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232215:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.232223:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580316.236196:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1889, 64 off129088 00010000:00010000:3.0:1777580316.236357:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.236380:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.236395:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.236406:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.236414:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.236421:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.239902:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580316.239989:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240003:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240011:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240017:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.240022:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240030:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240048:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa0249f048b00) 00010000:00010000:3.0:1777580316.240051:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580316.240056:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240062:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5b6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x803:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240092:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240098:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240104:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240119:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.240123:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240129:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240151:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.240154:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.240157:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.240163:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c5a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.240174:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008d7b90f6 reply state 000000001c54d93d transno 8589950917 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.240185:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580316.243610:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.243632:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.243648:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.243655:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.243666:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.243687:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x803:0x0].0x0 (ffffa0249f048b00) 00010000:00010000:2.0:1777580316.243692:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.243698:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.243715:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5bd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x803:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.243748:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.243752:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.243754:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580316.248274:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+476:283343:x1863919946733952:12345-192.168.202.9@tcp:36:rm.500 Request processed in 16595us (17003us total) trans 8589950917 rc 0/0 00000100:00100000:3.0:1777580316.248292:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19740 00000100:00100000:3.0:1777580316.248303:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837162234175 time 7837180510434 state 0x2 ref 0 00010000:00010000:2.0:1777580316.263251:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263287:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263298:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263305:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.263311:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263319:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263342:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa0249f048d00) 00010000:00010000:2.0:1777580316.263346:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.263351:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.263358:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.267078:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580316.271725:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.272021:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946734208 00000100:00100000:3.0:1777580316.272036:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946734208 00000100:00100000:3.0:1777580316.272086:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837162234175 time 7837180510434 state 0x0 ref 1 00000100:00100000:3.0:1777580316.272128:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837180610434 time 7837180510434 state 0x1 ref 1 00000100:00100000:3.0:1777580316.272203:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837180610434 time 7837221063876 state 0x0 ref 1 00000100:00100000:3.0:1777580316.272219:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283331:x1863919946734208:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580316.272319:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580316.272356:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c37f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x800:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea65 expref: 475 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272385:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c014 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x800:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9a8 expref: 474 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272397:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:3.0:1777580316.272410:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.272440:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272458:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272469:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272487:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272494:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272501:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272665:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272674:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.272682:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580316.273612:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1892, 64 off129280 00000004:00080000:3.0:1777580316.273626:0:207396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7837222490730ns, next at 7838222488051ns, rc = 0 00010000:00010000:3.0:1777580316.273702:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.273717:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.273728:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.273736:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.273744:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.273751:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274378:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580316.274415:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274440:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274446:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274452:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.274458:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274466:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274480:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:3.0:1777580316.274483:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580316.274488:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274494:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c5d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x800:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274520:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274527:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274533:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274537:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.274545:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274551:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274558:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.274561:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.274564:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.274568:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c5c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.274579:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006caab8ba reply state 00000000b2bac862 transno 8589950918 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.274589:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.274723:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+475:283331:x1863919946734208:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2501us (3003us total) trans 8589950918 rc 0/0 00000100:00100000:3.0:1777580316.274734:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19741 00000100:00100000:3.0:1777580316.274745:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837180610434 time 7837221063876 state 0x2 ref 0 00010000:00010000:2.0:1777580316.276396:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.276412:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.276427:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.276432:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.276442:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.276472:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x800:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:2.0:1777580316.276475:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.276480:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.276486:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c5d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x800:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.276516:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.276519:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.276521:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.291747:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291773:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291782:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291790:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.291835:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291844:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291867:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa0249f048500) 00010000:00010000:2.0:1777580316.291871:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.291877:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.291884:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4c5cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.293463:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.294117:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946734464 00000100:00100000:2.0:1777580316.294148:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946734464 00000100:00100000:2.0:1777580316.294207:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837180610434 time 7837221063876 state 0x0 ref 1 00000100:00100000:2.0:1777580316.294226:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837221163876 time 7837221063876 state 0x1 ref 1 00000100:00100000:2.0:1777580316.294258:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837221163876 time 7837243119152 state 0x0 ref 1 00000100:00100000:2.0:1777580316.294274:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283329:x1863919946734464:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.294621:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.294657:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4c39b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea6c expref: 474 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294678:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4bfa4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e99a expref: 473 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294714:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbd200) 00010000:00010000:2.0:1777580316.294727:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.294765:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294784:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294810:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294830:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294837:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.294843:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.296194:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.296211:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.296222:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.298847:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1890, 64 off129152 00010000:00010000:2.0:1777580316.298999:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299032:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299048:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299059:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299065:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299073:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299101:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.299163:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299170:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299177:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299184:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f149c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.299189:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299198:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299226:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:2.0:1777580316.299229:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.299236:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299243:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149c00/0xcb2b2f2f7e4c5ee lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299268:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.299274:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301214:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301222:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.301229:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301239:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301259:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.301262:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.301266:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301273:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4c5e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.301586:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fd5d5bc8 reply state 000000004a9709b9 transno 8589950919 ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.301598:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.301750:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+474:283329:x1863919946734464:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7473us (8292us total) trans 8589950919 rc 0/0 00000100:00100000:2.0:1777580316.301764:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19742 00000100:00100000:2.0:1777580316.301775:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837221163876 time 7837243119152 state 0x2 ref 0 00010000:00010000:2.0:1777580316.301855:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.301862:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301870:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.301874:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301881:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301891:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x7ff:0x0].0x0 (ffffa02493bbdb00) 00010000:00010000:2.0:1777580316.301894:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.301897:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301903:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148c00/0xcb2b2f2f7e4c5f5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x7ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.301924:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.301926:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.301937:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580316.321159:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.321869:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321899:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321907:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321914:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f148800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.321920:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321929:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321961:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02493bbdc00) 00010000:00010000:2.0:1777580316.321965:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.321971:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.321978:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f148800/0xcb2b2f2f7e4c5e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.322029:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946734720 00000100:00100000:2.0:1777580316.322041:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946734720 00000100:00100000:2.0:1777580316.322086:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837221163876 time 7837243119152 state 0x0 ref 1 00000100:00100000:2.0:1777580316.322099:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837243219152 time 7837243119152 state 0x1 ref 1 00000100:00100000:2.0:1777580316.322131:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837243219152 time 7837270993364 state 0x0 ref 1 00000100:00100000:2.0:1777580316.322183:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+473:283344:x1863919946734720:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.322258:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.322294:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c35c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x804:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea7a expref: 473 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322327:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4c1db lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x804:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea11 expref: 472 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322340:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580316.322351:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.322391:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322409:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322431:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322448:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322455:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322688:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322871:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322891:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.322899:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.323575:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1893, 64 off129344 00010000:00010000:2.0:1777580316.323657:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323668:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323678:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323686:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323692:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323699:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323722:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.323747:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323752:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323771:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323777:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.323782:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323790:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323815:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:2.0:1777580316.323819:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.323824:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323832:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c60a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x804:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323855:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323861:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323866:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323871:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.323874:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323890:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323899:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.323901:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.323905:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.323910:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c5fc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.323921:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d8b04ac reply state 000000003859b781 transno 8589950920 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.323930:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.324052:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+473:283344:x1863919946734720:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1869us (2920us total) trans 8589950920 rc 0/0 00000100:00100000:2.0:1777580316.324064:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19743 00000100:00100000:2.0:1777580316.324072:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837243219152 time 7837270993364 state 0x2 ref 0 00010000:00010000:2.0:1777580316.324300:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.324308:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.324314:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.324318:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.324323:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.324344:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x804:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:2.0:1777580316.324347:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.324349:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.324355:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c611 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x804:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.324372:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.324374:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.324376:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580316.348349:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.354631:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354653:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354661:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354668:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.354674:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354682:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354702:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.354706:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.354723:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.354730:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c603 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.355090:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946734976 00000100:00100000:2.0:1777580316.355104:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946734976 00000100:00100000:2.0:1777580316.355166:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837243219152 time 7837270993364 state 0x0 ref 1 00000100:00100000:2.0:1777580316.355181:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837271093364 time 7837270993364 state 0x1 ref 1 00000100:00100000:2.0:1777580316.355208:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837271093364 time 7837304069885 state 0x0 ref 1 00000100:00100000:2.0:1777580316.355225:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+472:283341:x1863919946734976:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.355302:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.355323:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4c378 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x802:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea73 expref: 472 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355341:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c110 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x802:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9d2 expref: 471 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355351:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa0241785fd00) 00010000:00010000:2.0:1777580316.355360:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.355604:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355624:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355635:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355662:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355669:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.355675:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.365759:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.365814:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.365832:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.385577:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1894, 64 off129408 00010000:00010000:2.0:1777580316.385813:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385839:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385855:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385864:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385871:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385901:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.385930:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.386326:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386335:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386341:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386348:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.386353:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386361:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386390:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.386394:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.386399:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386405:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c626 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x802:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386433:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386453:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386469:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386474:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.386477:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386483:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386492:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.386494:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.386498:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.386504:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c618 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.386517:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b1efc872 reply state 000000001f82c381 transno 8589950921 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.386526:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.396675:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+472:283341:x1863919946734976:12345-192.168.202.9@tcp:36:rm.500 Request processed in 41436us (48322us total) trans 8589950921 rc 0/0 00000100:00100000:2.0:1777580316.396697:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19744 00000100:00100000:2.0:1777580316.396711:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837271093364 time 7837304069885 state 0x2 ref 0 00010000:00010000:2.0:1777580316.397679:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.397694:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.397706:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.397711:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.397722:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.397744:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x802:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.397748:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.397754:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.397761:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c62d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x802:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.397785:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.397786:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.397789:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580316.407569:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.409172:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409193:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409201:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409208:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.409225:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409233:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409253:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024aee2d600) 00010000:00010000:2.0:1777580316.409257:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.409263:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.409269:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fa00/0xcb2b2f2f7e4c61f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.409865:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946735232 00000100:00100000:2.0:1777580316.409881:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946735232 00000100:00100000:2.0:1777580316.409929:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837271093364 time 7837304069885 state 0x0 ref 1 00000100:00100000:2.0:1777580316.409944:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837304169885 time 7837304069885 state 0x1 ref 1 00000100:00100000:3.0:1777580316.410810:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837304169885 time 7837359667988 state 0x0 ref 1 00000100:00100000:3.0:1777580316.410840:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+471:283352:x1863919946735232:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580316.410953:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580316.411004:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c4c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x808:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaea expref: 471 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411042:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c2ec lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x808:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea49 expref: 470 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411058:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa02483f8ec00) 00010000:00010000:3.0:1777580316.411073:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.411104:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411121:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411153:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411172:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411180:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411188:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411369:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411377:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.411398:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580316.415691:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1895, 64 off129472 00010000:00010000:3.0:1777580316.415973:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.415999:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416013:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416023:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416031:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416039:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416062:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.416072:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.416083:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416092:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580316.416094:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416102:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416108:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416832:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416847:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416869:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:2.0:1777580316.416887:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580316.416895:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.416895:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416906:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c649 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x808:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416907:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416924:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.416935:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580316.416938:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x808:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:2.0:1777580316.416939:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.416941:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580316.416945:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580316.416950:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.416956:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c642 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x808:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417000:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417008:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417016:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417023:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.417027:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417033:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417062:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.417066:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.417071:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.417078:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c634 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.417095:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000714ac6ca reply state 000000004edcc1bb transno 8589950922 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.417108:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.417655:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+471:283352:x1863919946735232:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6821us (10092us total) trans 8589950922 rc 0/0 00000100:00100000:3.0:1777580316.417668:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19745 00000100:00100000:3.0:1777580316.417679:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837304169885 time 7837359667988 state 0x2 ref 0 00010000:00010000:2.0:1777580316.422184:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422208:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422218:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422225:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.422234:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422244:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422268:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0249f048500) 00010000:00010000:2.0:1777580316.422272:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.422279:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.422286:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c63b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.423613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.424703:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946735488 00000100:00100000:2.0:1777580316.424719:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946735488 00000100:00100000:2.0:1777580316.424773:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837304169885 time 7837359667988 state 0x0 ref 1 00000100:00100000:2.0:1777580316.424789:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837359767988 time 7837359667988 state 0x1 ref 1 00000100:00100000:2.0:1777580316.424838:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837359767988 time 7837373699823 state 0x0 ref 1 00000100:00100000:2.0:1777580316.424854:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+470:283348:x1863919946735488:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.424995:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.425029:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c482 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x806:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eadc expref: 470 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425053:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c275 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x806:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea2d expref: 469 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425065:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa0248e788800) 00010000:00010000:2.0:1777580316.425077:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.425107:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425124:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425155:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425174:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425201:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.425211:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.426111:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.426125:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.426157:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.427734:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1896, 64 off129536 00010000:00010000:2.0:1777580316.427853:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427872:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427884:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427893:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427900:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427906:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.427943:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.428239:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428248:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428255:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428262:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.428268:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428286:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428301:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.428305:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.428311:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428318:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c65e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x806:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428347:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428354:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428371:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428393:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.428397:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428404:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428415:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.428418:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.428421:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428427:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c650 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.428440:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000013ae1576 reply state 000000001b8837a7 transno 8589950923 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.428450:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.428747:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+470:283348:x1863919946735488:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3891us (5137us total) trans 8589950923 rc 0/0 00000100:00100000:2.0:1777580316.428760:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19746 00000100:00100000:2.0:1777580316.428773:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837359767988 time 7837373699823 state 0x2 ref 0 00010000:00010000:2.0:1777580316.428842:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.428850:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428868:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.428873:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428880:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428890:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x806:0x0].0x0 (ffffa024b7eb0b00) 00010000:00010000:2.0:1777580316.428893:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.428897:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428903:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c665 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x806:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.428930:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.428933:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.428936:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580316.437543:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.437639:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946735744 00000100:00100000:3.0:1777580316.437651:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946735744 00000100:00100000:3.0:1777580316.437704:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837359767988 time 7837373699823 state 0x0 ref 1 00000100:00100000:3.0:1777580316.437720:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837373799823 time 7837373699823 state 0x1 ref 1 00000100:00100000:3.0:1777580316.437752:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837373799823 time 7837386613944 state 0x0 ref 1 00010000:00010000:2.0:1777580316.437753:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.437769:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.437777:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.437781:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+470:283367:x1863919946735744:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.437804:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.437810:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.437843:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.437865:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.437869:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.437875:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.437881:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c657 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.437883:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580316.437919:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f149600/0xcb2b2f2f7e4c4f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf8 expref: 469 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.437945:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c412 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x80a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eac0 expref: 468 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.437957:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0241785f000) 00010000:00010000:3.0:1777580316.437970:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.438000:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438019:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438032:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438051:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438060:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438068:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438275:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438300:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.438320:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580316.439532:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1897, 64 off129600 00010000:00010000:3.0:1777580316.439623:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.439638:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.439649:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.439657:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.439664:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.439670:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.440773:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.440787:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.440815:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.440820:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.440829:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 5/0,0 mode: PW/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.440847:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:2.0:1777580316.440849:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.440856:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 3/0,0 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.440864:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.440866:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.440867:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580316.440875:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777580316.440884:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c681 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440927:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440936:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440957:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440964:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.440969:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440977:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.440988:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80a:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:3.0:1777580316.440992:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580316.440996:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441003:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c67a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x80a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441034:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441041:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441048:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441054:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.441058:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441076:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441087:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.441090:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.441094:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.441101:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c66c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.441113:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007f0c1c8f reply state 00000000c17ef268 transno 8589950924 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.441124:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.441495:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+469:283367:x1863919946735744:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3711us (4219us total) trans 8589950924 rc 0/0 00000100:00100000:3.0:1777580316.441507:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19747 00000100:00100000:3.0:1777580316.441516:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837373799823 time 7837386613944 state 0x2 ref 0 00000100:00100000:2.0:1777580316.452330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580316.453677:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453695:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453704:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453710:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.453716:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453726:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453747:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa0249f048f00) 00010000:00010000:2.0:1777580316.453750:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.453756:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.453763:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c673 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.453826:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946736000 00000100:00100000:2.0:1777580316.453838:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946736000 00000100:00100000:2.0:1777580316.453880:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837373799823 time 7837386613944 state 0x0 ref 1 00000100:00100000:2.0:1777580316.453894:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837386713944 time 7837386613944 state 0x1 ref 1 00000100:00100000:2.0:1777580316.453919:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837386713944 time 7837402781276 state 0x0 ref 1 00000100:00100000:2.0:1777580316.453941:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283355:x1863919946736000:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.454019:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.454038:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c4dd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x809:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaf1 expref: 468 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454054:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4c3a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x809:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaa4 expref: 467 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454063:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa0248e788b00) 00010000:00010000:2.0:1777580316.454072:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.454103:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454117:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454127:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454162:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454170:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454176:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454327:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454340:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.454347:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.456000:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1891, 64 off129216 00010000:00010000:2.0:1777580316.456093:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456113:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456125:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456168:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456175:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456182:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456202:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.456230:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456235:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456253:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456259:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.456264:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.456272:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457655:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.457660:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.457668:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457676:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4c696 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x809:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457711:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457719:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457725:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457731:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.457734:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457760:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457769:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.457772:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.457775:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.457781:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4c688 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.457802:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ffcff249 reply state 00000000a2ca81ac transno 8589950925 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.457814:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.458033:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+468:283355:x1863919946736000:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4087us (5715us total) trans 8589950925 rc 0/0 00000100:00100000:2.0:1777580316.458047:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19748 00000100:00100000:2.0:1777580316.458058:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837386713944 time 7837402781276 state 0x2 ref 0 00010000:00010000:2.0:1777580316.458116:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.458123:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.458129:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.458160:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.458168:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.458190:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x809:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.458192:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.458195:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.458201:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c69d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x809:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.458222:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.458224:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.458226:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580316.472991:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.474477:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474494:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474502:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474530:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.474537:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474546:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474569:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa024b7eb0b00) 00010000:00010000:1.0:1777580316.474572:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.474578:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474586:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4c68f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.474643:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946736256 00000100:00100000:1.0:1777580316.474656:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946736256 00000100:00100000:1.0:1777580316.474704:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837386713944 time 7837402781276 state 0x0 ref 1 00000100:00100000:1.0:1777580316.474720:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837402881276 time 7837402781276 state 0x1 ref 1 00000100:00100000:1.0:1777580316.474757:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837402881276 time 7837423618994 state 0x0 ref 1 00000100:00100000:1.0:1777580316.474776:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283350:x1863919946736256:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580316.474873:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580316.474897:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c4a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x807:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eae3 expref: 467 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474919:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4c2a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x807:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea3b expref: 466 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474939:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa02490544700) 00010000:00010000:1.0:1777580316.474950:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580316.474982:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.474999:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475012:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475029:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475037:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475044:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475291:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475301:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.475308:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580316.476786:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1892, 64 off129280 00010000:00010000:1.0:1777580316.476906:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476930:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476942:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476951:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476959:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476965:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.476989:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580316.477019:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477025:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477032:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477038:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.477043:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477050:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477072:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa024aca38e00) 00010000:00010000:1.0:1777580316.477075:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580316.477081:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477087:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c6b2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x807:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477109:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477116:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477122:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477128:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.477130:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477162:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477170:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580316.477173:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.477177:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477184:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4c6a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.477208:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000051cf84a8 reply state 00000000bbcf03ec transno 8589950926 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.477218:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580316.477338:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283350:x1863919946736256:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2566us (4358us total) trans 8589950926 rc 0/0 00000100:00100000:1.0:1777580316.477350:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19749 00000100:00100000:1.0:1777580316.477358:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837402881276 time 7837423618994 state 0x2 ref 0 00010000:00010000:1.0:1777580316.477579:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580316.477586:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477593:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580316.477597:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477604:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477614:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x807:0x0].0x0 (ffffa024aca38e00) 00010000:00010000:1.0:1777580316.477617:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580316.477619:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477626:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c6b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x807:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.477644:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580316.477646:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580316.477655:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580316.480261:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480293:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480303:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480310:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.480316:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480325:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480345:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024aca38800) 00010000:00010000:1.0:1777580316.480349:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.480355:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.480362:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c6ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.484179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.484232:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946736384 00000100:00100000:3.0:1777580316.484244:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946736384 00000100:00100000:3.0:1777580316.484302:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837402881276 time 7837423618994 state 0x0 ref 1 00000100:00100000:3.0:1777580316.484318:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837423718994 time 7837423618994 state 0x1 ref 1 00000100:00100000:3.0:1777580316.484350:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837423718994 time 7837433211984 state 0x0 ref 1 00000100:00100000:3.0:1777580316.484366:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:283376:x1863919946736384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.484603:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.484633:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c6c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb45 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484735:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484756:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484779:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484807:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484816:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484824:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.484993:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485003:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485010:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580316.485043:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x80b:0x0]: returning size 0 00000004:00200000:3.0:1777580316.485054:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580316.485081:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485097:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485106:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485114:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485121:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485128:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.485155:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485164:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485178:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.485181:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.485186:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485193:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c6c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485208:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485225:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485232:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485237:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.485241:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485247:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485254:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0249f048d00) 00010000:00010000:3.0:1777580316.485256:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.485258:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485263:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c6ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485302:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c6c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb45 expref: 468 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485317:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb45 expref: 467 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.485324:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048900) 00010000:00010000:3.0:1777580316.485327:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.485336:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:3.0:1777580316.485940:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283376:x1863919946736384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1573us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.485954:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19750 00000100:00100000:3.0:1777580316.485963:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837423718994 time 7837433211984 state 0x2 ref 0 00000100:00100000:2.0:1777580316.491372:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.491420:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946736640 00000100:00100000:2.0:1777580316.491433:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946736640 00000100:00100000:2.0:1777580316.491483:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837423718994 time 7837433211984 state 0x0 ref 1 00000100:00100000:2.0:1777580316.491500:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837433311984 time 7837433211984 state 0x1 ref 1 00000100:00100000:2.0:1777580316.491533:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837433311984 time 7837440394625 state 0x0 ref 1 00000100:00100000:2.0:1777580316.491547:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283377:x1863919946736640:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.491631:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.491668:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c57e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb37 expref: 467 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491692:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c515 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x80c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb22 expref: 466 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491716:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa02493bbdf00) 00010000:00010000:2.0:1777580316.491729:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.491764:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491783:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491809:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491835:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491843:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.491850:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492024:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492042:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492050:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.492716:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1898, 64 off129664 00010000:00010000:2.0:1777580316.492827:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492847:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492856:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492864:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492870:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492876:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492903:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.492932:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492938:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492944:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492951:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.492956:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492964:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.492997:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:2.0:1777580316.493000:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.493004:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493011:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c6ea lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x80c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493030:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493036:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493041:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493046:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.493048:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493053:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493061:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.493063:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.493066:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493083:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.493104:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007c3d3db9 reply state 00000000516e6cd5 transno 8589950927 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.493113:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.493273:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+467:283377:x1863919946736640:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1722us (1908us total) trans 8589950927 rc 0/0 00000100:00100000:2.0:1777580316.493284:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19751 00000100:00100000:2.0:1777580316.493292:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837433311984 time 7837440394625 state 0x2 ref 0 00010000:00010000:2.0:1777580316.493342:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.493349:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493356:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.493360:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493367:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493376:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80c:0x0].0x0 (ffffa024aee2d600) 00010000:00010000:2.0:1777580316.493378:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.493381:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493386:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c6f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.493403:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.493405:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.493414:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580316.499273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.499500:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499515:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499524:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499540:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.499547:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499556:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499576:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024aee2da00) 00010000:00010000:1.0:1777580316.499580:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.499585:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.499592:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997fe00/0xcb2b2f2f7e4c6e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.499665:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946736768 00000100:00100000:0.0:1777580316.499678:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946736768 00000100:00100000:0.0:1777580316.499808:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12031 00000100:00100000:0.0:1777580316.499822:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2363:x1863919946736768:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580316.499850:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.499881:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb4c expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580316.502986:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c6:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:0.0:1777580316.503032:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580316.503035:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580316.503052:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.503081:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 33 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.503098:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030200, rc 0) 00000100:00100000:0.0:1777580316.503204:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2363:x1863919946736768:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3384us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580316.503215:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12031 00000100:00100000:2.0:1777580316.513822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.513873:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946737024 00000100:00100000:2.0:1777580316.513888:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946737024 00000100:00100000:2.0:1777580316.513942:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837433311984 time 7837440394625 state 0x0 ref 1 00000100:00100000:2.0:1777580316.513960:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837440494625 time 7837440394625 state 0x1 ref 1 00000100:00100000:2.0:1777580316.513988:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837440494625 time 7837462849698 state 0x0 ref 1 00000100:00100000:2.0:1777580316.514002:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:283376:x1863919946737024:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580316.514086:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580316.514121:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c6d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb45 expref: 466 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514170:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c489 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x80b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ead5 expref: 465 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514182:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa0249f048900) 00010000:00010000:2.0:1777580316.514196:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.514226:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514245:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514256:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514273:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514302:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.514311:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520148:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520178:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520194:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580316.520866:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1893, 64 off129344 00010000:00010000:2.0:1777580316.520962:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520977:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520988:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.520998:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521005:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521014:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521045:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580316.521078:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521084:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521089:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521095:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.521101:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521109:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521123:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.521126:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580316.521131:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521161:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ea00/0xcb2b2f2f7e4c70d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x80b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521185:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521190:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521204:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521209:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997f600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580316.521211:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521217:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521225:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580316.521227:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580316.521230:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521234:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4c6ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.521260:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b04bb781 reply state 000000005248739b transno 8589950928 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.521270:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.521416:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+466:283376:x1863919946737024:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7411us (7603us total) trans 8589950928 rc 0/0 00000100:00100000:2.0:1777580316.521429:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19752 00000100:00100000:2.0:1777580316.521438:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837440494625 time 7837462849698 state 0x2 ref 0 00010000:00010000:2.0:1777580316.521499:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580316.521506:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521522:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580316.521525:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521531:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521539:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80b:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.521541:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580316.521544:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521549:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c714 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.521564:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.521565:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580316.521567:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580316.531154:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531175:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531184:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531190:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.531196:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531204:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531249:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024aee2d600) 00010000:00010000:1.0:1777580316.531253:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.531259:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.531267:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4c706 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.591018:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580316.591079:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946737280 00000100:00100000:0.0:1777580316.591093:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946737280 00000100:00100000:0.0:1777580316.591183:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837043190179 time 7837075454775 state 0x0 ref 1 00000100:00100000:0.0:1777580316.591200:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837075554775 time 7837075454775 state 0x1 ref 1 00000100:00100000:0.0:1777580316.591231:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837075554775 time 7837540093118 state 0x0 ref 1 00000100:00100000:0.0:1777580316.591245:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283391:x1863919946737280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580316.591280:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.591311:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c71b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb53 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591512:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591534:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591550:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591573:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591580:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.591586:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580316.592254:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c7:0x0], index 1: 0 00010000:00010000:0.0:1777580316.592476:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c730 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592496:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592506:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592551:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592558:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592565:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592573:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580316.592577:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592587:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592599:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580316.592602:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580316.592608:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592616:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c722 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580316.592636:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d9631c8a reply state 00000000a22d7737 transno 8589950929 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.592653:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580316.592697:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c71b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb53 expref: 143 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592717:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c730 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb53 expref: 142 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.592724:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa02484c59800) 00010000:00010000:0.0:1777580316.592726:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580316.592729:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:0.0:1777580316.592846:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283391:x1863919946737280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1604us (1847us total) trans 8589950929 rc 0/0 00000100:00100000:0.0:1777580316.592856:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19753 00000100:00100000:0.0:1777580316.592863:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837075554775 time 7837540093118 state 0x2 ref 0 00000100:00100000:3.0:1777580316.595546:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.595587:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946737536 00000100:00100000:3.0:1777580316.600011:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946737536 00000100:00100000:3.0:1777580316.600078:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837075554775 time 7837540093118 state 0x0 ref 1 00000100:00100000:3.0:1777580316.600099:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837540193118 time 7837540093118 state 0x1 ref 1 00000100:00100000:3.0:1777580316.600157:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837540193118 time 7837549018689 state 0x0 ref 1 00000100:00100000:3.0:1777580316.600177:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+143:283391:x1863919946737536:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580316.600255:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580316.600291:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c730 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb53 expref: 143 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.600319:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580316.600331:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.600427:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.600445:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.600458:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.600651:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d8ff1cf reply state 00000000388e3203 transno 8589950930 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.600663:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580316.600924:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600934:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600942:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600949:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.600955:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600964:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600975:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024ae57b400) 00010000:00010000:1.0:1777580316.600978:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.600982:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.600989:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c729 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.603980:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580316.604202:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946737792 00000100:00100000:0.0:1777580316.604214:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946737792 00000100:00100000:0.0:1777580316.604272:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837549118689 time 7837549018689 state 0x1 ref 2 00000100:00100000:0.0:1777580316.604308:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837549118689 time 7837553169041 state 0x0 ref 2 00000100:00100000:0.0:1777580316.604322:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283392:x1863919946737792:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580316.604351:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.604382:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c745 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb5a expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604597:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604615:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604628:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604645:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604652:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.604658:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580316.605290:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ec:0x0], index 0: 0 00010000:00010000:0.0:1777580316.605498:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c75a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605511:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605520:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605563:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605584:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605592:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605598:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580316.605602:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605611:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605624:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580316.605627:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580316.605632:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605638:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c74c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580316.605656:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b1578e74 reply state 00000000e2978213 transno 8589950931 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.605665:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580316.605705:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c745 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb5a expref: 147 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605721:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c75a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb5a expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.605743:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580316.605745:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580316.605748:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:0.0:1777580316.605858:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+147:283392:x1863919946737792:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1538us (1890us total) trans 8589950931 rc 0/0 00000100:00100000:0.0:1777580316.605868:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19755 00000100:00100000:3.0:1777580316.606984:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283391:x1863919946737536:12345-192.168.202.9@tcp:36:touch.500 Request processed in 6807us (11443us total) trans 8589950930 rc 0/0 00000100:00100000:3.0:1777580316.606996:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19754 00000100:00100000:3.0:1777580316.607004:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837549118689 time 7837553169041 state 0x2 ref 0 00010000:00010000:1.0:1777580316.622328:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622352:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622361:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622369:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.622375:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622384:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622407:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:1.0:1777580316.622412:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.622418:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622425:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c73e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622472:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622479:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622485:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622514:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.622517:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622524:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622533:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02484c59100) 00010000:00010000:1.0:1777580316.622536:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.622539:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.622545:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c753 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.622975:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.630078:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946737920 00000100:00100000:3.0:1777580316.630098:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946737920 00000100:00100000:3.0:1777580316.630262:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837549118689 time 7837553169041 state 0x0 ref 1 00000100:00100000:3.0:1777580316.630279:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837553269041 time 7837553169041 state 0x1 ref 1 00000100:00100000:3.0:1777580316.630311:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837553269041 time 7837579173385 state 0x0 ref 1 00000100:00100000:3.0:1777580316.630333:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283391:x1863919946737920:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.630371:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.630405:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c768 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb61 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.630487:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb61 expref: 145 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.630506:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb61 expref: 145 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.630550:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa0249f048b00) 00010000:00010000:3.0:1777580316.630554:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580316.630559:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:3.0:1777580316.630644:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239235c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283391:x1863919946737920:12345-192.168.202.9@tcp:101:touch.500 Request processed in 321us (7676us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.630653:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19756 00000100:00100000:3.0:1777580316.630659:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837553269041 time 7837579173385 state 0x2 ref 0 00000100:00100000:3.0:1777580316.630823:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.631550:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946738176 00000100:00100000:2.0:1777580316.631561:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946738176 00000100:00100000:2.0:1777580316.631600:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837553269041 time 7837579173385 state 0x0 ref 1 00000100:00100000:2.0:1777580316.631612:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837579273385 time 7837579173385 state 0x1 ref 1 00000100:00100000:2.0:1777580316.631638:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837579273385 time 7837580501633 state 0x0 ref 1 00000100:00100000:2.0:1777580316.631652:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283392:x1863919946738176:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580316.631722:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580316.631755:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c75a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb5a expref: 145 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.631809:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:2.0:1777580316.631822:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580316.631918:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.631931:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.631944:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580316.632159:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fffe8987 reply state 000000001dedb16c transno 8589950932 ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.632170:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.632282:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283392:x1863919946738176:12345-192.168.202.9@tcp:36:touch.500 Request processed in 633us (1459us total) trans 8589950932 rc 0/0 00000100:00100000:2.0:1777580316.632291:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19757 00000100:00100000:2.0:1777580316.632296:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837579273385 time 7837580501633 state 0x2 ref 0 00010000:00010000:1.0:1777580316.639605:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.639630:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.639639:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.639647:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.639653:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.639662:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.640105:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:1.0:1777580316.640111:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.640118:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.640128:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997e600/0xcb2b2f2f7e4c76f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.658939:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.659047:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.663060:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946738304 00000100:00100000:2.0:1777580316.663083:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946738304 00000100:00100000:2.0:1777580316.663218:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12032 00000100:00100000:2.0:1777580316.663230:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946738304:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580316.663721:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946738304:12345-192.168.202.9@tcp:2:touch.500 Request processed in 491us (4790us total) trans 8589938635 rc 0/0 00000100:00100000:2.0:1777580316.663730:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12032 00000100:00080000:3.0:1777580316.663984:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777580316.668063:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946738432 00000100:00100000:0.0:1777580316.668084:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946738432 00000100:00100000:0.0:1777580316.668160:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837579273385 time 7837580501633 state 0x0 ref 1 00000100:00100000:0.0:1777580316.668177:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837580601633 time 7837580501633 state 0x1 ref 1 00000100:00100000:0.0:1777580316.668208:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837580601633 time 7837617070336 state 0x0 ref 1 00000100:00100000:0.0:1777580316.668227:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283392:x1863919946738432:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580316.668261:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.668298:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c776 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb68 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.668382:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c776 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb68 expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.668401:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c776 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb68 expref: 146 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.668424:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580316.668436:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580316.668440:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:0.0:1777580316.668533:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283392:x1863919946738432:12345-192.168.202.9@tcp:101:touch.500 Request processed in 314us (9485us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580316.668542:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19758 00000100:00100000:0.0:1777580316.668547:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837580601633 time 7837617070336 state 0x2 ref 0 00000100:00100000:3.0:1777580316.671228:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.671282:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946738688 00000100:00100000:3.0:1777580316.671293:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946738688 00000100:00100000:3.0:1777580316.671346:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837580601633 time 7837617070336 state 0x0 ref 1 00000100:00100000:3.0:1777580316.671361:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837617170336 time 7837617070336 state 0x1 ref 1 00000100:00100000:3.0:1777580316.671387:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837617170336 time 7837620249182 state 0x0 ref 1 00000100:00100000:3.0:1777580316.671401:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283399:x1863919946738688:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.671427:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.671452:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c77d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb6f expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671644:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671673:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671687:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671704:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671712:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.671719:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580316.675599:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c8:0x0], index 1: 0 00010000:00010000:3.0:1777580316.683200:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c792 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683229:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683243:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683297:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683305:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683312:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683329:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.683334:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683341:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683355:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.683358:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.683363:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683369:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c784 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.683384:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000371e8419 reply state 000000009bf441dd transno 8589950933 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.683394:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580316.683448:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c77d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb6f expref: 149 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683465:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c792 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb6f expref: 148 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.683473:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048000) 00010000:00010000:3.0:1777580316.683476:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.683479:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:3.0:1777580316.683590:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283399:x1863919946738688:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12190us (12378us total) trans 8589950933 rc 0/0 00000100:00100000:3.0:1777580316.683607:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19759 00000100:00100000:3.0:1777580316.683616:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837617170336 time 7837620249182 state 0x2 ref 0 00000100:00100000:3.0:1777580316.683847:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.684298:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946738944 00000100:00100000:3.0:1777580316.684310:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946738944 00000100:00100000:3.0:1777580316.684378:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4228 00000100:00100000:3.0:1777580316.684388:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283391:x1863919946738944:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580316.685999:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283391:x1863919946738944:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1600us (2140us total) trans 8589950934 rc 0/0 00000100:00100000:3.0:1777580316.686014:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4228 00000100:00100000:3.0:1777580316.690613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.690859:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690874:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690883:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690890:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.690896:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690906:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690926:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa0249f048300) 00010000:00010000:1.0:1777580316.690930:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.690936:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.690944:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c78b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.692002:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946739072 00000100:00100000:0.0:1777580316.692022:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946739072 00000100:00100000:0.0:1777580316.692107:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12033 00000100:00100000:0.0:1777580316.692120:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2363:x1863919946739072:12345-192.168.202.9@tcp:2:touch.500 00000100:00080000:3.0:1777580316.692501:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580316.699305:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2363:x1863919946739072:12345-192.168.202.9@tcp:2:touch.500 Request processed in 7168us (8688us total) trans 8589939035 rc 0/0 00000100:00100000:0.0:1777580316.699322:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12033 00000100:00100000:3.0:1777580316.702349:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.702389:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.702424:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946739328 00000100:00100000:3.0:1777580316.702436:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946739328 00000100:00100000:3.0:1777580316.702486:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837617170336 time 7837620249182 state 0x0 ref 1 00000100:00100000:3.0:1777580316.702502:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837620349182 time 7837620249182 state 0x1 ref 1 00000100:00100000:3.0:1777580316.702521:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946739584 00000100:00100000:3.0:1777580316.702524:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946739584 00000100:00100000:3.0:1777580316.702536:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837620349182 time 7837620249182 state 0x1 ref 2 00000100:00100000:3.0:1777580316.702565:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837651527287 time 7837651427287 state 0x1 ref 2 00000100:00100000:3.0:1777580316.702578:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283399:x1863919946739328:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580316.702667:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580316.702702:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c792 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb6f expref: 150 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.702724:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048000) 00010000:00010000:3.0:1777580316.702739:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.702854:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.702872:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.702882:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.703059:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002e6a6def reply state 00000000f0f31769 transno 8589950935 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.703070:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.703223:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283399:x1863919946739328:12345-192.168.202.9@tcp:36:touch.500 Request processed in 646us (886us total) trans 8589950935 rc 0/0 00000100:00100000:3.0:1777580316.703233:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19760 00000100:00100000:3.0:1777580316.703262:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837651527287 time 7837652124682 state 0x0 ref 1 00000100:00100000:3.0:1777580316.703274:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+150:283397:x1863919946739584:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.703287:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.703300:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c7a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb76 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703454:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703466:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703474:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703487:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703494:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.703500:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580316.704265:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ed:0x0], index 0: 0 00010000:00010000:3.0:1777580316.704466:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c7bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704479:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c7bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704488:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c7bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704531:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704552:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704559:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704566:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.704570:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704579:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704592:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.704595:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.704601:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704607:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c7ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.704623:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002e7f48df reply state 000000000712bdae transno 8589950936 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.704632:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580316.704669:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c7a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb76 expref: 153 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704686:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c7bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb76 expref: 152 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.704708:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:3.0:1777580316.704710:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.704713:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:3.0:1777580316.712111:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:283397:x1863919946739584:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1515us (2396us total) trans 8589950936 rc 0/0 00000100:00100000:3.0:1777580316.712161:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19761 00000100:00100000:3.0:1777580316.712172:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837651527287 time 7837652124682 state 0x2 ref 0 00010000:00010000:1.0:1777580316.719736:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719759:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719767:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719774:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.719780:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719800:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719822:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:1.0:1777580316.719826:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.719831:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.719837:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c7a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.732007:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.732040:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.732124:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.732179:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946739712 00000100:00100000:3.0:1777580316.732192:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946739712 00000100:00100000:3.0:1777580316.732258:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837651527287 time 7837652124682 state 0x0 ref 1 00000100:00100000:3.0:1777580316.732277:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837652224682 time 7837652124682 state 0x1 ref 1 00000100:00100000:3.0:1777580316.732304:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946739968 00000100:00100000:3.0:1777580316.732308:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946739968 00000100:00100000:3.0:1777580316.732321:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837652224682 time 7837652124682 state 0x1 ref 2 00000100:00100000:3.0:1777580316.732387:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946740224 00000100:00100000:3.0:1777580316.732392:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946740224 00000100:00100000:3.0:1777580316.732405:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837652224682 time 7837652124682 state 0x1 ref 3 00000100:00100000:3.0:1777580316.732428:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837681390827 time 7837681290827 state 0x1 ref 3 00000100:00100000:3.0:1777580316.732440:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283399:x1863919946739712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.732500:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.732533:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c7ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb7d expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.732617:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c7ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb7d expref: 155 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.732635:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c7ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb7d expref: 155 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.732660:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048900) 00010000:00010000:3.0:1777580316.732664:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580316.732669:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:3.0:1777580316.732736:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283399:x1863919946739712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 296us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.732745:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19762 00000100:00100000:3.0:1777580316.732770:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837681733047 time 7837681633047 state 0x1 ref 2 00000100:00100000:3.0:1777580316.732781:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283397:x1863919946739968:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580316.732848:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580316.732873:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c7bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb76 expref: 154 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.732891:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:3.0:1777580316.732902:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.732974:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.732993:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733004:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.733236:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000068adf956 reply state 000000000190a5d0 transno 8589950937 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.733248:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.733313:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283397:x1863919946739968:12345-192.168.202.9@tcp:36:touch.500 Request processed in 533us (1272us total) trans 8589950937 rc 0/0 00000100:00100000:3.0:1777580316.733320:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19763 00000100:00100000:3.0:1777580316.733338:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837681733047 time 7837682200882 state 0x0 ref 1 00000100:00100000:3.0:1777580316.733348:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283400:x1863919946740224:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.733357:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.733368:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c7d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb84 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733485:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733496:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733505:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733533:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733541:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.733547:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580316.734166:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c9:0x0], index 1: 0 00010000:00010000:3.0:1777580316.734353:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c7ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734365:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734374:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734415:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734424:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734431:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734438:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.734443:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734465:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734477:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.734481:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.734485:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734493:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c7df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.734508:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4905328 reply state 000000004a31fe08 transno 8589950938 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.734516:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580316.734556:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c7d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb84 expref: 157 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734571:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c7ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb84 expref: 156 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.734579:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa024989ec600) 00010000:00010000:3.0:1777580316.734582:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.734584:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0000, rc 0) 00000100:00100000:3.0:1777580316.734642:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:283400:x1863919946740224:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1295us (2517us total) trans 8589950938 rc 0/0 00000100:00100000:3.0:1777580316.734651:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19764 00000100:00100000:3.0:1777580316.734658:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837681733047 time 7837682200882 state 0x2 ref 0 00010000:00010000:1.0:1777580316.739967:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.739993:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.740002:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.740036:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.740044:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.740052:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.740076:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0249f048a00) 00010000:00010000:1.0:1777580316.740079:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.740085:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.740093:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c7b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.754663:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.754740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.754759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.754805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.754935:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.754950:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.754958:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.754965:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.754971:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.754979:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755039:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:1.0:1777580316.755043:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.755050:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755057:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c7d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755101:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755110:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755116:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755121:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.755124:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755130:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755160:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0249f048500) 00010000:00010000:1.0:1777580316.755163:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.755166:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.755172:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c7e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.759422:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.759539:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946740480 00000100:00100000:2.0:1777580316.759553:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946740480 00000100:00100000:2.0:1777580316.759626:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4229 00000100:00100000:2.0:1777580316.759639:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283392:x1863919946740480:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580316.763578:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946740992 00000100:00100000:1.0:1777580316.763605:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946740992 00000100:00100000:1.0:1777580316.763675:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837681733047 time 7837682200882 state 0x0 ref 1 00000100:00100000:1.0:1777580316.763693:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837682300882 time 7837682200882 state 0x1 ref 1 00000100:00100000:1.0:1777580316.763734:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946741248 00000100:00100000:1.0:1777580316.763738:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946741248 00000100:00100000:1.0:1777580316.763756:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837682300882 time 7837682200882 state 0x1 ref 2 00000100:00100000:1.0:1777580316.763775:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946740736 00000100:00100000:1.0:1777580316.763778:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946740736 00000100:00100000:1.0:1777580316.763801:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837682300882 time 7837682200882 state 0x1 ref 3 00000100:00100000:1.0:1777580316.763822:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837712784527 time 7837712684527 state 0x1 ref 3 00000100:00100000:1.0:1777580316.763840:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:283400:x1863919946740992:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580316.763928:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580316.763963:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c7ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb84 expref: 158 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.763988:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa024989ec600) 00010000:00010000:1.0:1777580316.764001:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580316.764097:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.764112:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.764177:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.764365:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c4616e18 reply state 000000004c9c8d9d transno 8589950940 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.764376:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580316.764563:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283392:x1863919946740480:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4925us (9912us total) trans 8589950939 rc 0/0 00000100:00100000:2.0:1777580316.764577:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4229 00000100:00100000:1.0:1777580316.765072:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:283400:x1863919946740992:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1238us (10328us total) trans 8589950940 rc 0/0 00000100:00100000:1.0:1777580316.765082:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19765 00000100:00100000:1.0:1777580316.765115:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837714076475 time 7837713976475 state 0x1 ref 2 00000100:00100000:1.0:1777580316.765182:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:283401:x1863919946741248:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580316.765201:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.765222:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c802 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb8b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580316.766541:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837714076475 time 7837715396531 state 0x0 ref 2 00000100:00100000:2.0:1777580316.766582:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:283397:x1863919946740736:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580316.766603:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580316.766632:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c809 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb92 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.766706:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c809 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x830:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb92 expref: 159 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.766725:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c809 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x830:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb92 expref: 159 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580316.766749:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:2.0:1777580316.766752:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580316.766776:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997f400, rc 0) 00000100:00100000:2.0:1777580316.766863:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283397:x1863919946740736:12345-192.168.202.9@tcp:101:touch.500 Request processed in 300us (12056us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580316.766872:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19767 00010000:00010000:1.0:1777580316.768356:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.768378:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.768390:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.768408:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.768435:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.768442:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580316.769185:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ee:0x0], index 0: 0 00010000:00010000:1.0:1777580316.769450:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c81e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769465:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769475:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769522:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769531:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769539:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769546:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.769551:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769560:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769590:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580316.769593:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.769599:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769607:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c810 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.769624:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004f68cfcc reply state 000000006fb7e20b transno 8589950941 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.769635:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580316.769682:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c802 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb8b expref: 160 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769698:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb8b expref: 159 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.769705:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa024aca38d00) 00010000:00010000:1.0:1777580316.769708:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580316.769710:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:1.0:1777580316.776163:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:283401:x1863919946741248:12345-192.168.202.9@tcp:101:touch.500 Request processed in 11006us (21372us total) trans 8589950941 rc 0/0 00000100:00100000:1.0:1777580316.776180:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19766 00000100:00100000:1.0:1777580316.776191:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837714076475 time 7837715396531 state 0x2 ref 0 00000100:00100000:1.0:1777580316.778330:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946740608 00000100:00100000:1.0:1777580316.778351:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946740608 00000100:00100000:1.0:1777580316.778441:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12034 00000100:00100000:1.0:1777580316.778455:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946740608:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580316.778952:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946740608:12345-192.168.202.9@tcp:2:touch.500 Request processed in 499us (19542us total) trans 8589938636 rc 0/0 00000100:00100000:1.0:1777580316.778961:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12034 00000100:00100000:3.0:1777580316.804391:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.804433:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.804444:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804462:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804471:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804477:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.804482:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804490:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804510:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa024aca38800) 00010000:00010000:1.0:1777580316.804513:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.804518:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804525:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c7fb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.804538:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580316.804563:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804583:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804589:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804593:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.804597:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804603:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804611:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024aca38e00) 00010000:00010000:1.0:1777580316.804614:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.804617:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.804624:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c817 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580316.805108:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946741376 00000100:00100000:0.0:1777580316.805121:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946741376 00000100:00100000:0.0:1777580316.805184:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837714076475 time 7837715396531 state 0x0 ref 1 00000100:00100000:0.0:1777580316.805199:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837715496531 time 7837715396531 state 0x1 ref 1 00000100:00100000:0.0:1777580316.805228:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837715496531 time 7837754089662 state 0x0 ref 1 00000100:00100000:0.0:1777580316.805242:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+158:283400:x1863919946741376:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580316.805267:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580316.805293:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c82c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eb99 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.805367:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c82c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x831:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb99 expref: 159 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.806083:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c82c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x831:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb99 expref: 159 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580316.806114:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa02484c59100) 00010000:00010000:0.0:1777580316.806118:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580316.806122:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ba00, rc 0) 00000100:00100000:0.0:1777580316.806237:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283400:x1863919946741376:12345-192.168.202.9@tcp:101:touch.500 Request processed in 997us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580316.806247:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19768 00000100:00100000:0.0:1777580316.806254:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837715496531 time 7837754089662 state 0x2 ref 0 00000100:00100000:0.0:1777580316.806306:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946741504 00000100:00100000:0.0:1777580316.806314:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946741504 00000100:00100000:0.0:1777580316.806358:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12035 00000100:00100000:0.0:1777580316.806366:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2361:x1863919946741504:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580316.808553:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946741760 00000100:00100000:2.0:1777580316.808572:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946741760 00000100:00100000:2.0:1777580316.808639:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4230 00000100:00100000:2.0:1777580316.808651:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283399:x1863919946741760:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580316.809597:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946741504:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3222us (5154us total) trans 8589939036 rc 0/0 00000100:00100000:0.0:1777580316.809610:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12035 00000100:00100000:2.0:1777580316.811334:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:283399:x1863919946741760:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2673us (6782us total) trans 8589950942 rc 0/0 00000100:00100000:2.0:1777580316.811350:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4230 00000100:00100000:3.0:1777580316.811805:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.811885:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.811991:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742016 00000100:00100000:3.0:1777580316.812003:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742016 00000100:00100000:3.0:1777580316.812049:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837715496531 time 7837754089662 state 0x0 ref 1 00000100:00100000:3.0:1777580316.812064:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837754189662 time 7837754089662 state 0x1 ref 1 00000100:00100000:3.0:1777580316.812082:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742144 00000100:00100000:3.0:1777580316.812085:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742144 00000100:00100000:3.0:1777580316.812100:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837440494625 time 7837462849698 state 0x0 ref 1 00000100:00100000:3.0:1777580316.812106:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837462949698 time 7837462849698 state 0x1 ref 1 00000100:00100000:3.0:1777580316.812125:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837462949698 time 7837760987270 state 0x0 ref 1 00000100:00100000:3.0:1777580316.812156:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:283403:x1863919946742144:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.812183:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.812208:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c833 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eba0 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812288:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812305:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812342:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812359:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812378:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812386:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812525:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812533:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812540:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580316.812576:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82d:0x0]: returning size 0 00000004:00200000:3.0:1777580316.812581:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580316.812602:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812616:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812626:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812642:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812648:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812654:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.812659:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812668:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812682:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.812684:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.812689:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812695:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c83a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812707:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812713:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812717:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812722:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.812730:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812736:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812743:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa0241785fd00) 00010000:00010000:3.0:1777580316.812745:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.812747:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812752:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c841 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812785:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4c833 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba0 expref: 163 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812813:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba0 expref: 162 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.812820:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa0249f048b00) 00010000:00010000:3.0:1777580316.812822:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.812824:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0e00, rc 0) 00000100:00100000:1.0:1777580316.812883:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837754189662 time 7837761743050 state 0x0 ref 1 00000100:00100000:3.0:1777580316.812885:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+162:283403:x1863919946742144:12345-192.168.202.9@tcp:101:rm.500 Request processed in 751us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.812894:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19770 00000100:00100000:1.0:1777580316.812898:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+162:283401:x1863919946742016:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:3.0:1777580316.812899:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837462949698 time 7837760987270 state 0x2 ref 0 00010000:00010000:1.0:1777580316.812939:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580316.815150:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c81e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb8b expref: 161 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.815189:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa024aca38d00) 00010000:00010000:1.0:1777580316.815226:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580316.815334:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.815351:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.815364:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.815567:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000787d3e54 reply state 00000000acaf9863 transno 8589950943 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.815578:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580316.816559:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+162:283401:x1863919946742016:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3653us (4759us total) trans 8589950943 rc 0/0 00000100:00100000:1.0:1777580316.816573:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19769 00000100:00100000:1.0:1777580316.816582:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837754189662 time 7837761743050 state 0x2 ref 0 00000100:00100000:3.0:1777580316.820253:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580316.821515:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742272 00000100:00100000:0.0:1777580316.821531:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742272 00000100:00100000:0.0:1777580316.821616:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12036 00000100:00100000:0.0:1777580316.821628:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946742272:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580316.823921:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946742272:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2280us (3666us total) trans 8589938637 rc 0/0 00000100:00100000:0.0:1777580316.823939:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12036 00000100:00100000:3.0:1777580316.856922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.856968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.856993:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.857014:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580316.857925:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946743040 00000100:00100000:2.0:1777580316.857944:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946743040 00000100:00100000:2.0:1777580316.858036:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4231 00000100:00100000:2.0:1777580316.858049:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+162:283397:x1863919946743040:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580316.858585:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283397:x1863919946743040:12345-192.168.202.9@tcp:35:touch.500 Request processed in 537us (1588us total) trans 8589950944 rc 0/0 00000100:00100000:2.0:1777580316.858595:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4231 00010000:00010000:1.0:1777580316.865171:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865195:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865204:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865211:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.865217:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865253:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865274:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:1.0:1777580316.865278:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.865282:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.865289:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c84f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.865355:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742528 00000100:00100000:1.0:1777580316.865368:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742528 00000100:00100000:3.0:1777580316.865668:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.865834:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742400 00000100:00100000:3.0:1777580316.865840:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742400 00000100:00100000:3.0:1777580316.865892:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12037 00000100:00100000:3.0:1777580316.865902:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946742400:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580316.865925:0:188247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.865949:0:188247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eba7 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580316.865983:0:188247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c7:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:3.0:1777580316.866006:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580316.866008:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580316.866019:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 28 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.866037:0:188247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 28 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.866051:0:188247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1000, rc 0) 00000100:00100000:3.0:1777580316.866167:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946742400:12345-192.168.202.9@tcp:101:rm.500 Request processed in 266us (9151us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.866175:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12037 00000100:00100000:3.0:1777580316.866208:0:187625:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946743168 00000100:00100000:3.0:1777580316.866214:0:187625:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946743168 00000100:00100000:3.0:1777580316.866256:0:187625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 423 00000100:00100000:3.0:1777580316.866262:0:187625:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946743168:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580316.866306:0:187625:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946743168:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.866313:0:187625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 423 00000100:00100000:1.0:1777580316.866650:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837754189662 time 7837761743050 state 0x0 ref 1 00000100:00100000:1.0:1777580316.866662:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761843050 time 7837761743050 state 0x1 ref 1 00000100:00100000:1.0:1777580316.866684:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946742784 00000100:00100000:1.0:1777580316.866688:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946742784 00000100:00100000:1.0:1777580316.866700:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761843050 time 7837761743050 state 0x1 ref 2 00000100:00100000:1.0:1777580316.866717:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815679577 time 7837815579577 state 0x1 ref 2 00000100:00100000:1.0:1777580316.866727:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283401:x1863919946742528:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580316.866740:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.866759:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c85d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebae expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.866836:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c85d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x832:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebae expref: 164 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.866861:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c85d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x832:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebae expref: 164 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.866880:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:1.0:1777580316.866884:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580316.866887:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000100:00100000:1.0:1777580316.866921:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:283401:x1863919946742528:12345-192.168.202.9@tcp:101:touch.500 Request processed in 195us (10017us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580316.866929:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19771 00000100:00100000:1.0:1777580316.866949:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815679577 time 7837815811863 state 0x0 ref 1 00000100:00100000:1.0:1777580316.866969:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283405:x1863919946742784:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580316.866977:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580316.866989:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c864 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebb5 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867127:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867167:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867176:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867193:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867212:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.867218:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.868809:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:1.0:1777580316.872210:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ca:0x0], index 1: 0 00010000:00010000:1.0:1777580316.872568:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c879 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872591:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c879 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872606:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c879 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872657:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872665:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872672:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872678:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580316.872682:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872690:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872721:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580316.872724:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580316.872730:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872738:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c86b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580316.872754:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e34ee19 reply state 00000000b092030b transno 8589950945 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580316.872764:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580316.872826:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c864 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebb5 expref: 166 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872845:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c879 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebb5 expref: 165 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580316.872852:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa0249f048a00) 00010000:00010000:1.0:1777580316.872855:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580316.872857:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6800, rc 0) 00000100:00100000:1.0:1777580316.874239:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+166:283405:x1863919946742784:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6000us (15989us total) trans 8589950945 rc 0/0 00000100:00100000:1.0:1777580316.874256:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19772 00000100:00100000:1.0:1777580316.874268:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815679577 time 7837815811863 state 0x2 ref 0 00000100:00100000:2.0:1777580316.878192:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946743424 00000100:00100000:2.0:1777580316.878215:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946743424 00000100:00100000:2.0:1777580316.878297:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4232 00000100:00100000:2.0:1777580316.878308:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+166:283400:x1863919946743424:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580316.882081:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:283400:x1863919946743424:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3758us (13279us total) trans 8589950946 rc 0/0 00000100:00100000:2.0:1777580316.882099:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4232 00000100:00100000:3.0:1777580316.894345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.894439:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580316.894497:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894511:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894520:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894526:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.894532:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894540:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894561:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0249f048000) 00010000:00010000:3.0:1777580316.894565:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.894571:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.894579:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c872 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.896419:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946743808 00000100:00100000:3.0:1777580316.896436:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946743808 00000100:00100000:3.0:1777580316.896484:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815679577 time 7837815811863 state 0x0 ref 1 00000100:00100000:3.0:1777580316.896501:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815911863 time 7837815811863 state 0x1 ref 1 00000100:00100000:3.0:1777580316.896531:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815911863 time 7837845392887 state 0x0 ref 1 00000100:00100000:3.0:1777580316.896548:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+166:283405:x1863919946743808:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580316.897285:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580316.897323:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c879 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebb5 expref: 166 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.897344:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa0249f048a00) 00010000:00010000:3.0:1777580316.897355:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580316.897448:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.897463:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.897474:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.897629:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000055690ea2 reply state 00000000eb1507c2 transno 8589950947 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.897639:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580316.897824:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:283405:x1863919946743808:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1280us (3492us total) trans 8589950947 rc 0/0 00000100:00100000:3.0:1777580316.897834:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19773 00000100:00100000:3.0:1777580316.897842:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815911863 time 7837845392887 state 0x2 ref 0 00000100:00100000:0.0:1777580316.904441:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946743552 00000100:00100000:0.0:1777580316.904459:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946743552 00000100:00100000:0.0:1777580316.904527:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12038 00000100:00100000:0.0:1777580316.904538:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946743552:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580316.904987:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946743552:12345-192.168.202.9@tcp:2:touch.500 Request processed in 450us (10546us total) trans 8589939037 rc 0/0 00000100:00100000:0.0:1777580316.904997:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12038 00000100:00100000:3.0:1777580316.907117:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.907297:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946744064 00000100:00100000:3.0:1777580316.907309:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946744064 00000100:00100000:3.0:1777580316.907356:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837815911863 time 7837845392887 state 0x0 ref 1 00000100:00100000:3.0:1777580316.907371:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837845492887 time 7837845392887 state 0x1 ref 1 00000100:00100000:3.0:1777580316.907397:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837845492887 time 7837856258938 state 0x0 ref 1 00000100:00100000:3.0:1777580316.907409:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:283409:x1863919946744064:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.907434:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.907459:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c88e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebbc expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907621:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907639:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907651:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907667:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907696:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.907704:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580316.919738:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ef:0x0], index 0: 0 00010000:00010000:3.0:1777580316.919984:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c8a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920006:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920019:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920061:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920068:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920075:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920080:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.920084:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920092:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920120:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580316.920124:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.920129:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920165:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1600/0xcb2b2f2f7e4c895 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580316.920182:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d9de0fa reply state 00000000979eee24 transno 8589950948 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.920193:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580316.920239:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4c88e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebbc expref: 170 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920255:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebbc expref: 169 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920263:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:3.0:1777580316.920266:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580316.920268:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0c00, rc 0) 00000100:00100000:3.0:1777580316.920360:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283409:x1863919946744064:12345-192.168.202.9@tcp:101:touch.500 Request processed in 12952us (13262us total) trans 8589950948 rc 0/0 00000100:00100000:3.0:1777580316.920370:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19774 00000100:00100000:3.0:1777580316.920379:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837845492887 time 7837856258938 state 0x2 ref 0 00010000:00010000:3.0:1777580316.920623:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920644:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920651:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920656:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.920659:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920665:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920674:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580316.920676:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.920679:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.920686:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4c887 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580316.926396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580316.926530:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946744192 00000100:00100000:3.0:1777580316.926543:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946744192 00000100:00100000:3.0:1777580316.926595:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837845492887 time 7837856258938 state 0x0 ref 1 00000100:00100000:3.0:1777580316.926612:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837856358938 time 7837856258938 state 0x1 ref 1 00000100:00100000:3.0:1777580316.926641:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837856358938 time 7837875504310 state 0x0 ref 1 00000100:00100000:3.0:1777580316.926654:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+169:283405:x1863919946744192:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580316.926706:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580316.926736:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c8b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebc3 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.926835:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x833:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebc3 expref: 170 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.926853:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x833:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebc3 expref: 170 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.926875:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:3.0:1777580316.926879:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580316.926883:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1c00, rc 0) 00000100:00100000:3.0:1777580316.926951:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283405:x1863919946744192:12345-192.168.202.9@tcp:101:touch.500 Request processed in 299us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580316.926960:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19775 00000100:00100000:3.0:1777580316.926965:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837856358938 time 7837875504310 state 0x2 ref 0 00010000:00010000:3.0:1777580316.927001:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927010:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927018:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927025:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580316.927030:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927046:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927058:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0241785f800) 00010000:00010000:3.0:1777580316.927061:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580316.927064:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580316.927070:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4c89c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.004443:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.004494:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946744448 00000100:00100000:1.0:1777580317.004516:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946744448 00000100:00100000:1.0:1777580317.004585:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837856358938 time 7837875504310 state 0x0 ref 1 00000100:00100000:1.0:1777580317.004600:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837875604310 time 7837875504310 state 0x1 ref 1 00000100:00100000:1.0:1777580317.004630:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837875604310 time 7837953491992 state 0x0 ref 1 00000100:00100000:1.0:1777580317.004644:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+169:283409:x1863919946744448:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.004723:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.004770:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4c8a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebbc expref: 169 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.004802:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa02493ac1d00) 00010000:00010000:1.0:1777580317.004817:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.004907:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.004925:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.004936:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.007260:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000539af021 reply state 0000000041f45c5d transno 8589950949 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.010692:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.010917:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283409:x1863919946744448:12345-192.168.202.9@tcp:36:touch.500 Request processed in 6268us (6479us total) trans 8589950949 rc 0/0 00000100:00100000:1.0:1777580317.010929:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19776 00000100:00100000:1.0:1777580317.010960:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837875604310 time 7837953491992 state 0x2 ref 0 00000100:00080000:1.0:1777580317.011027:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777580317.011254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.011491:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.011523:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.011561:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946744960 00000100:00100000:1.0:1777580317.011572:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946744960 00000100:00100000:1.0:1777580317.011611:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837875604310 time 7837953491992 state 0x0 ref 1 00000100:00100000:1.0:1777580317.011627:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837953591992 time 7837953491992 state 0x1 ref 1 00000100:00100000:1.0:1777580317.011654:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837953591992 time 7837960515791 state 0x0 ref 1 00000100:00100000:1.0:1777580317.011667:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283407:x1863919946744960:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.011693:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.011720:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c8bf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebca expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.011922:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.011943:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.011956:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.011975:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.012000:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.012007:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.016210:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946745088 00000100:00100000:3.0:1777580317.016229:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946745088 00000100:00100000:3.0:1777580317.016479:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12039 00000100:00100000:3.0:1777580317.016491:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946745088:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580317.016953:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946745088:12345-192.168.202.9@tcp:2:touch.500 Request processed in 460us (5423us total) trans 8589938638 rc 0/0 00000100:00100000:3.0:1777580317.016962:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12039 00000100:00100000:3.0:1777580317.017211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.017249:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017260:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017268:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017273:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.017299:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017309:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017332:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0249f048500) 00010000:00010000:3.0:1777580317.017335:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.017340:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017347:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c8b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.017388:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946745216 00000100:00100000:3.0:1777580317.017394:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946745216 00000100:00100000:3.0:1777580317.017427:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837960615791 time 7837960515791 state 0x1 ref 2 00000100:00100000:3.0:1777580317.017451:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837960615791 time 7837966312938 state 0x0 ref 2 00000100:00100000:3.0:1777580317.017462:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+171:283409:x1863919946745216:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580317.017482:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.017502:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c8d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebd1 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017563:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x834:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd1 expref: 172 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017579:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x834:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd1 expref: 172 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.017651:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0241785f800) 00010000:00010000:3.0:1777580317.017654:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580317.017657:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb2000, rc 0) 00000100:00100000:3.0:1777580317.017691:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+172:283409:x1863919946745216:12345-192.168.202.9@tcp:101:touch.500 Request processed in 231us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.017698:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19778 00000100:00100000:2.0:1777580317.020251:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946744704 00000100:00100000:2.0:1777580317.020269:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946744704 00000100:00100000:2.0:1777580317.020345:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4233 00000100:00100000:2.0:1777580317.020356:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+172:283401:x1863919946744704:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.020819:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+173:283401:x1863919946744704:12345-192.168.202.9@tcp:35:touch.500 Request processed in 464us (9565us total) trans 8589950950 rc 0/0 00000100:00100000:2.0:1777580317.020830:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4233 00000004:00080000:1.0:1777580317.023987:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15cb:0x0], index 1: 0 00010000:00010000:1.0:1777580317.024316:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c8db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024339:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024354:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024403:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024410:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024418:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024424:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.024429:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024437:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024470:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.024473:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.024479:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024486:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c8c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.024502:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000df9e6c03 reply state 000000006e7f41b4 transno 8589950951 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.024513:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580317.024562:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c8bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebca expref: 174 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024579:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c8db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebca expref: 173 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.024587:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0249f048300) 00010000:00010000:1.0:1777580317.024589:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.024592:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:1.0:1777580317.024680:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+174:283407:x1863919946744960:12345-192.168.202.9@tcp:101:touch.500 Request processed in 13014us (13188us total) trans 8589950951 rc 0/0 00000100:00100000:1.0:1777580317.024690:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19777 00000100:00100000:1.0:1777580317.024698:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837960615791 time 7837966312938 state 0x2 ref 0 00000100:00100000:1.0:1777580317.040602:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.040678:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.040719:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.040841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.040879:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040896:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040905:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040912:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.040918:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040926:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040948:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa0249f048f00) 00010000:00010000:1.0:1777580317.040952:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.040958:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.040965:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c8cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.041020:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946745600 00000100:00100000:1.0:1777580317.041034:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946745600 00000100:00100000:1.0:1777580317.041395:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12040 00000100:00100000:1.0:1777580317.041408:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946745600:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580317.041847:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946745600:12345-192.168.202.9@tcp:2:touch.500 Request processed in 441us (1167us total) trans 8589939038 rc 0/0 00000100:00100000:1.0:1777580317.041868:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12040 00000100:00100000:1.0:1777580317.041905:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946745856 00000100:00100000:1.0:1777580317.041912:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946745856 00000100:00100000:1.0:1777580317.041939:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837960615791 time 7837966312938 state 0x0 ref 1 00000100:00100000:1.0:1777580317.041952:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837966412938 time 7837966312938 state 0x1 ref 1 00000100:00100000:1.0:1777580317.041968:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946746112 00000100:00100000:1.0:1777580317.041972:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946746112 00000100:00100000:1.0:1777580317.041982:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837966412938 time 7837966312938 state 0x1 ref 2 00000100:00100000:1.0:1777580317.041999:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837990961338 time 7837990861338 state 0x1 ref 2 00000100:00100000:1.0:1777580317.042009:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+174:283407:x1863919946745856:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.042068:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777580317.042627:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946745472 00000100:00100000:2.0:1777580317.042635:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946745472 00000100:00100000:2.0:1777580317.042678:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4234 00000100:00100000:2.0:1777580317.042687:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:283405:x1863919946745472:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.043077:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:283405:x1863919946745472:12345-192.168.202.9@tcp:35:touch.500 Request processed in 391us (2490us total) trans 8589950952 rc 0/0 00000100:00100000:2.0:1777580317.043802:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4234 00010000:00010000:1.0:1777580317.044671:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c8db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebca expref: 175 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.044700:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0249f048300) 00010000:00010000:1.0:1777580317.044716:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.044839:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.044856:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.044868:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.045041:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000795a197c reply state 00000000c7fd8655 transno 8589950953 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.045052:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.047530:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:283407:x1863919946745856:12345-192.168.202.9@tcp:36:touch.500 Request processed in 5505us (6794us total) trans 8589950953 rc 0/0 00000100:00100000:1.0:1777580317.047544:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19779 00000100:00100000:1.0:1777580317.047603:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837990961338 time 7837996461745 state 0x0 ref 1 00000100:00100000:1.0:1777580317.047623:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:283410:x1863919946746112:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.047647:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.047676:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c8f0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebd8 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047877:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047896:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047909:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047925:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047932:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.047961:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.066289:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.066313:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.066322:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.066329:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.066335:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.066343:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580317.066622:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f0:0x0], index 0: 0 00010000:00010000:3.0:1777580317.067260:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0249f048a00) 00010000:00010000:3.0:1777580317.067265:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.067275:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.067285:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c8e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.067478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.067636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.067885:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c905 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067904:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067918:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c905 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067967:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067974:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067981:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067987:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.067991:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.067997:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.068007:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.068010:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.068022:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.068029:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c8f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.068042:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000052bc1430 reply state 000000003dac19ec transno 8589950954 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.068052:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580317.068304:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946746240 00000100:00100000:3.0:1777580317.068318:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946746240 00000100:00100000:3.0:1777580317.068450:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837996561745 time 7837996461745 state 0x1 ref 2 00000100:00100000:3.0:1777580317.068482:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837996561745 time 7838017343754 state 0x0 ref 2 00000100:00100000:3.0:1777580317.068496:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:283407:x1863919946746240:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580317.068523:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.068546:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c913 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebdf expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.068604:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c913 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x835:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebdf expref: 179 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.068618:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c913 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x835:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebdf expref: 179 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.068639:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580317.068641:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580317.068644:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6600, rc 0) 00000100:00100000:3.0:1777580317.068736:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+179:283407:x1863919946746240:12345-192.168.202.9@tcp:101:touch.500 Request processed in 242us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.068748:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19781 00010000:00010000:1.0:1777580317.069583:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c8f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd8 expref: 178 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.069611:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c905 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd8 expref: 177 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.069620:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:1.0:1777580317.069622:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.069625:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:1.0:1777580317.069686:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:283410:x1863919946746112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 22069us (28845us total) trans 8589950954 rc 0/0 00000100:00100000:1.0:1777580317.069694:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19780 00000100:00100000:1.0:1777580317.069701:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837996561745 time 7838017343754 state 0x2 ref 0 00000100:00100000:0.0:1777580317.076889:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.077333:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.077351:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.077359:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.078025:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946746624 00000100:00100000:3.0:1777580317.078041:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946746624 00000100:00100000:3.0:1777580317.078496:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12041 00000100:00100000:3.0:1777580317.078509:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946746624:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580317.079010:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946746624:12345-192.168.202.9@tcp:2:touch.500 Request processed in 503us (2137us total) trans 8589938639 rc 0/0 00000100:00100000:3.0:1777580317.079019:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12041 00010000:00010000:1.0:1777580317.079999:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.080007:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.080018:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.080041:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0249f048000) 00010000:00010000:1.0:1777580317.080044:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.080050:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.080058:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c8fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.081595:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946746496 00000100:00100000:2.0:1777580317.081613:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946746496 00000100:00100000:2.0:1777580317.081685:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4235 00000100:00100000:2.0:1777580317.081696:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+177:283409:x1863919946746496:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.082450:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:283409:x1863919946746496:12345-192.168.202.9@tcp:35:touch.500 Request processed in 753us (14810us total) trans 8589950955 rc 0/0 00000100:00100000:2.0:1777580317.082459:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4235 00000100:00100000:3.0:1777580317.088300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.088337:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.088417:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.089036:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946746880 00000100:00100000:0.0:1777580317.089050:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946746880 00000100:00100000:0.0:1777580317.089114:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837996561745 time 7838017343754 state 0x0 ref 1 00000100:00100000:0.0:1777580317.089130:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838017443754 time 7838017343754 state 0x1 ref 1 00000100:00100000:0.0:1777580317.089181:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946747136 00000100:00100000:0.0:1777580317.089185:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946747136 00000100:00100000:0.0:1777580317.089199:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838017443754 time 7838017343754 state 0x1 ref 2 00000100:00100000:0.0:1777580317.089221:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838038182685 time 7838038082685 state 0x1 ref 2 00000100:00100000:0.0:1777580317.089234:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+179:283414:x1863919946746880:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.089265:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.089291:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c91a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebe6 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089474:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089511:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089524:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089542:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089550:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.089556:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.090127:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15cc:0x0], index 1: 0 00010000:00010000:0.0:1777580317.090372:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c92f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090386:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c92f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090396:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c92f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090440:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090448:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090455:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090469:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.090474:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090483:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090497:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.090500:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.090505:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090512:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c921 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.090530:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000f961dec reply state 00000000df75cd63 transno 8589950956 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.090541:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.090584:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c91a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebe6 expref: 182 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090601:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c92f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebe6 expref: 181 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090609:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa02498977100) 00010000:00010000:0.0:1777580317.090611:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.090614:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8aa00, rc 0) 00000100:00100000:0.0:1777580317.090713:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283414:x1863919946746880:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1481us (2429us total) trans 8589950956 rc 0/0 00000100:00100000:0.0:1777580317.090731:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19782 00000100:00100000:0.0:1777580317.090772:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838038182685 time 7838039632918 state 0x0 ref 1 00000100:00100000:0.0:1777580317.090798:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283410:x1863919946747136:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580317.090844:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.090860:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c905 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd8 expref: 181 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090871:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa0249f048d00) 00010000:00010000:0.0:1777580317.090883:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.090950:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090960:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.090967:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.091068:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed2ef117 reply state 0000000036b0e47d transno 8589950957 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.091075:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.091117:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283410:x1863919946747136:12345-192.168.202.9@tcp:36:touch.500 Request processed in 334us (2778us total) trans 8589950957 rc 0/0 00000100:00100000:0.0:1777580317.091123:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19783 00000100:00100000:0.0:1777580317.091128:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838038182685 time 7838039632918 state 0x2 ref 0 00000100:00100000:3.0:1777580317.095411:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.095465:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946747392 00000100:00100000:3.0:1777580317.095480:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946747392 00000100:00100000:3.0:1777580317.095553:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4236 00000100:00100000:3.0:1777580317.095564:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283407:x1863919946747392:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580317.096092:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+183:283407:x1863919946747392:12345-192.168.202.9@tcp:35:touch.500 Request processed in 527us (7671us total) trans 8589950958 rc 0/0 00000100:00100000:3.0:1777580317.096101:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4236 00010000:00010000:3.0:1777580317.096170:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096183:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096190:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096196:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.096201:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096209:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096248:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02498977c00) 00010000:00010000:3.0:1777580317.096252:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.096257:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096265:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b200/0xcb2b2f2f7e4c928 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096304:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096312:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096318:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096322:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.096325:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096332:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096340:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa02484c59800) 00010000:00010000:3.0:1777580317.096343:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.096346:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096352:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4c93d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.096428:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946747520 00000100:00100000:3.0:1777580317.096434:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946747520 00000100:00100000:3.0:1777580317.096461:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837462949698 time 7837760987270 state 0x0 ref 1 00000100:00100000:3.0:1777580317.096474:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761087270 time 7837760987270 state 0x1 ref 1 00000100:00100000:3.0:1777580317.096499:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761087270 time 7838045361254 state 0x0 ref 1 00000100:00100000:3.0:1777580317.096511:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283413:x1863919946747520:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.096529:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.096550:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c944 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebed expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096617:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096633:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096645:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096661:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096669:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096676:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096837:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096846:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096853:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580317.096881:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82e:0x0]: returning size 0 00000004:00200000:3.0:1777580317.096886:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580317.096907:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096919:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096927:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096933:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096939:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096944:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.096947:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096953:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096970:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.096972:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.096975:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096981:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6800/0xcb2b2f2f7e4c94b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096992:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.096998:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097004:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097009:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.097012:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097018:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097026:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024ad9fd900) 00010000:00010000:3.0:1777580317.097028:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.097032:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097038:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7800/0xcb2b2f2f7e4c952 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097082:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7400/0xcb2b2f2f7e4c944 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 183 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097097:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 182 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.097105:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580317.097107:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.097110:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb3e00, rc 0) 00000100:00100000:3.0:1777580317.097184:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283413:x1863919946747520:12345-192.168.202.9@tcp:101:rm.500 Request processed in 675us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.097194:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19784 00000100:00100000:3.0:1777580317.097200:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761087270 time 7838045361254 state 0x2 ref 0 00000100:00100000:1.0:1777580317.119314:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.119372:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946747648 00000100:00100000:1.0:1777580317.119384:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946747648 00000100:00100000:1.0:1777580317.119433:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838038182685 time 7838039632918 state 0x0 ref 1 00000100:00100000:1.0:1777580317.119448:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838039732918 time 7838039632918 state 0x1 ref 1 00000100:00100000:1.0:1777580317.119487:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838039732918 time 7838068348790 state 0x0 ref 1 00000100:00100000:1.0:1777580317.119500:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283410:x1863919946747648:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.119532:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.119565:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c960 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebf4 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.119665:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c960 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x836:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebf4 expref: 183 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.119684:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c960 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x836:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebf4 expref: 183 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.119707:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa0249f048000) 00010000:00010000:1.0:1777580317.119709:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.119714:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:1.0:1777580317.119801:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+183:283410:x1863919946747648:12345-192.168.202.9@tcp:101:touch.500 Request processed in 289us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.119810:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19785 00000100:00100000:1.0:1777580317.119815:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838039732918 time 7838068348790 state 0x2 ref 0 00000100:00100000:1.0:1777580317.119871:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.119999:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.120022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.120041:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.120060:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946747904 00000100:00100000:1.0:1777580317.120066:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946747904 00000100:00100000:1.0:1777580317.120085:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838039732918 time 7838068348790 state 0x0 ref 1 00000100:00100000:1.0:1777580317.120093:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838068448790 time 7838068348790 state 0x1 ref 1 00000100:00100000:1.0:1777580317.120109:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748032 00000100:00100000:1.0:1777580317.120112:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748032 00000100:00100000:1.0:1777580317.120124:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7837761087270 time 7838045361254 state 0x0 ref 1 00000100:00100000:1.0:1777580317.120183:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838045461254 time 7838045361254 state 0x1 ref 1 00000100:00100000:1.0:1777580317.120199:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748160 00000100:00100000:1.0:1777580317.120203:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748160 00000100:00100000:1.0:1777580317.120215:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838045461254 time 7838045361254 state 0x1 ref 2 00000100:00100000:1.0:1777580317.120226:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748288 00000100:00100000:1.0:1777580317.120228:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748288 00000100:00100000:1.0:1777580317.120238:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838045461254 time 7838045361254 state 0x1 ref 3 00000100:00100000:1.0:1777580317.120248:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838069212051 time 7838069112051 state 0x1 ref 3 00000100:00100000:1.0:1777580317.120257:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283425:x1863919946748032:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.120268:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.120283:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c967 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ebfb expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120351:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120362:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120372:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120388:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120396:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120411:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120552:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120562:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120570:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.120603:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x830:0x0]: returning size 0 00000004:00200000:1.0:1777580317.120608:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.120632:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120645:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120655:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120662:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120668:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120675:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.120679:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120695:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120708:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.120710:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.120715:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120721:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4c96e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120735:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120741:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120748:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120753:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.120756:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120761:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120769:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa0249f048300) 00010000:00010000:1.0:1777580317.120771:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.120774:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120807:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4c975 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120845:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4c967 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebfb expref: 188 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120859:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebfb expref: 187 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.120866:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:1.0:1777580317.120869:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.120872:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:1.0:1777580317.120926:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283425:x1863919946748032:12345-192.168.202.9@tcp:101:rm.500 Request processed in 669us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.120934:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19787 00000100:00100000:1.0:1777580317.120958:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838068448790 time 7838069820401 state 0x0 ref 1 00000100:00100000:1.0:1777580317.120969:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283414:x1863919946747904:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.121004:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.121019:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4c92f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebe6 expref: 186 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121033:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa02498977100) 00010000:00010000:1.0:1777580317.121042:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.121113:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121167:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121176:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.121347:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000005aaf2cb reply state 000000008e02959c transno 8589950959 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.121357:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.121410:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283414:x1863919946747904:12345-192.168.202.9@tcp:36:touch.500 Request processed in 442us (1538us total) trans 8589950959 rc 0/0 00000100:00100000:1.0:1777580317.121417:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19786 00000100:00100000:1.0:1777580317.121421:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838068448790 time 7838069820401 state 0x2 ref 0 00000100:00100000:1.0:1777580317.121440:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070403669 time 7838070303669 state 0x1 ref 2 00000100:00100000:1.0:1777580317.121451:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283434:x1863919946748160:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.121461:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.121471:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c98a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec02 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121510:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121519:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121527:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121549:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121557:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121563:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121639:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121647:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121654:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.121677:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x833:0x0]: returning size 0 00000004:00200000:1.0:1777580317.121680:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.121692:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121702:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121710:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121716:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121732:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121738:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.121742:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121749:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121757:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.121759:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.121763:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121769:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4c991 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121781:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121802:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121809:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121814:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.121816:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121834:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121842:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa0249f048500) 00010000:00010000:1.0:1777580317.121845:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.121848:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121853:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4c998 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121880:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4c98a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec02 expref: 188 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121892:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec02 expref: 187 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.121899:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:1.0:1777580317.121901:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.121903:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc400, rc 0) 00000100:00100000:1.0:1777580317.121929:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283434:x1863919946748160:12345-192.168.202.9@tcp:101:rm.500 Request processed in 479us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.121935:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19788 00000100:00100000:1.0:1777580317.121953:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070403669 time 7838070816089 state 0x0 ref 1 00000100:00100000:1.0:1777580317.121963:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283426:x1863919946748288:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.121972:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.121986:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4c9a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec09 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122017:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122025:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122033:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122045:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122052:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122059:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122114:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122122:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122130:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.122182:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x831:0x0]: returning size 0 00000004:00200000:1.0:1777580317.122185:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.122195:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122212:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122220:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122226:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122231:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122236:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.122239:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122245:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122252:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.122254:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.122257:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122263:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4c9ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122272:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122278:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122292:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122298:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.122300:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122307:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122315:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0249f048a00) 00010000:00010000:1.0:1777580317.122317:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.122320:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122325:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4c9b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122351:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4c9a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec09 expref: 188 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122363:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec09 expref: 187 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.122370:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580317.122373:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.122375:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bce00, rc 0) 00000100:00100000:1.0:1777580317.122399:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283426:x1863919946748288:12345-192.168.202.9@tcp:101:rm.500 Request processed in 437us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.122416:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19789 00000100:00100000:1.0:1777580317.122420:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070403669 time 7838070816089 state 0x2 ref 0 00000100:00100000:1.0:1777580317.122507:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.122579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.122621:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.122735:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748416 00000100:00100000:1.0:1777580317.122743:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748416 00000100:00100000:1.0:1777580317.122767:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070403669 time 7838070816089 state 0x0 ref 1 00000100:00100000:1.0:1777580317.122778:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070916089 time 7838070816089 state 0x1 ref 1 00000100:00100000:0.0:1777580317.123402:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748544 00000100:00100000:0.0:1777580317.123410:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748544 00000100:00100000:0.0:1777580317.123437:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838070916089 time 7838070816089 state 0x1 ref 2 00000100:00100000:0.0:1777580317.123457:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838072419327 time 7838072319327 state 0x1 ref 2 00000100:00100000:0.0:1777580317.123471:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:283433:x1863919946748416:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.123490:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.123508:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c9c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec10 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123585:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123599:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123611:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123628:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123635:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123640:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123748:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123772:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123779:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.123826:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x832:0x0]: returning size 0 00000004:00200000:0.0:1777580317.123830:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.123849:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123860:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123868:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123874:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123881:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123886:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.123890:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123896:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123907:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.123915:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.123920:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123926:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4c9c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123942:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123947:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123952:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123957:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.123960:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123965:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123972:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02481646400) 00010000:00010000:0.0:1777580317.123974:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.123976:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.123981:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4c9d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124014:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4c9c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec10 expref: 190 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124035:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec10 expref: 189 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124043:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:0.0:1777580317.124045:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.124048:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:0.0:1777580317.124354:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+189:283433:x1863919946748416:12345-192.168.202.9@tcp:101:rm.500 Request processed in 886us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.124363:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19790 00000100:00100000:0.0:1777580317.124394:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838072419327 time 7838073256841 state 0x0 ref 1 00000100:00100000:0.0:1777580317.124407:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:283419:x1863919946748544:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.124418:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.124429:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c9de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec17 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124466:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124475:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124483:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124496:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124515:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124522:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124595:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124603:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124610:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.124632:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82f:0x0]: returning size 0 00000004:00200000:0.0:1777580317.124635:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.124647:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124656:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124664:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124670:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124675:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124692:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.124695:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124701:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124710:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.124713:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.124716:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124722:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4c9e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124737:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124744:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124750:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124755:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.124758:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124764:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124783:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02481646b00) 00010000:00010000:0.0:1777580317.124795:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.124798:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124804:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4c9ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124833:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4c9de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec17 expref: 190 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124846:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec17 expref: 189 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.124853:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048900) 00010000:00010000:0.0:1777580317.124856:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.124859:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480031600, rc 0) 00000100:00100000:0.0:1777580317.124890:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+189:283419:x1863919946748544:12345-192.168.202.9@tcp:101:rm.500 Request processed in 486us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.124896:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19791 00000100:00100000:0.0:1777580317.124902:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838072419327 time 7838073256841 state 0x2 ref 0 00000001:00080000:2.0:1777580317.126379:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950931 is committed 00000001:00080000:2.0:1777580317.126409:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950895 is committed 00000004:00080000:2.0:1777580317.126446:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 208 committed 00000004:00080000:2.0:1777580317.126474:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 214 committed 00000004:00080000:2.0:1777580317.126576:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 212 committed 00000001:00080000:2.0:1777580317.126610:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950926 is committed 00000004:00080000:2.0:1777580317.126643:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 215 committed 00000001:00080000:2.0:1777580317.126837:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950932 is committed 00000001:00080000:2.0:1777580317.126847:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950928 is committed 00000004:00080000:2.0:1777580317.126873:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 209 committed 00000004:00080000:2.0:1777580317.126987:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 207 committed 00000004:00080000:2.0:1777580317.127058:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 206 committed 00000001:00080000:2.0:1777580317.127081:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589950938 is committed 00000004:00080000:2.0:1777580317.127333:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 216 committed 00000004:00080000:2.0:1777580317.127476:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 213 committed 00000100:00100000:2.0:1777580317.127541:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748672 00000100:00100000:2.0:1777580317.127554:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748672 00000100:00100000:2.0:1777580317.127626:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12042 00000100:00100000:2.0:1777580317.127637:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946748672:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580317.127663:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580317.127695:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec1e expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580317.127729:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ec:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:2.0:1777580317.127755:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.127758:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.127769:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 31 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.127800:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 31 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.127816:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997ea00, rc 0) 00000100:00100000:2.0:1777580317.127907:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2362:x1863919946748672:12345-192.168.202.9@tcp:101:rm.500 Request processed in 272us (5284us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.127915:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12042 00000100:00100000:0.0:1777580317.132616:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917478528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.132708:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.132774:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917479040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.135350:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917478656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580317.139809:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139887:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139911:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139933:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139977:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.139995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.142607:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.142729:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142744:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142779:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142797:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.142804:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142812:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142833:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa0249f048f00) 00010000:00010000:3.0:1777580317.142836:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.142841:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.142848:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4c983 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.143607:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143679:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.143716:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143741:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.143767:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143797:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917480192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.143818:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143848:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1777580317.143855:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917478784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.143875:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143891:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.143908:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143925:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02484c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479808:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.143958:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.143976:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917480320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.144003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.144038:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917478912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.144059:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.144074:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917479424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.144090:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.144118:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917479936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.144161:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.144176:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917480448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.144194:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.144232:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917478528 00000100:00100000:1.0:1777580317.144242:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917478528 00000100:00100000:1.0:1777580317.144301:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748800 00000100:00100000:1.0:1777580317.144304:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748800 00000100:00100000:1.0:1777580317.144316:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946748928 00000100:00100000:1.0:1777580317.144318:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946748928 00000100:00100000:1.0:1777580317.144328:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749056 00000100:00100000:1.0:1777580317.144331:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749056 00000100:00100000:1.0:1777580317.144341:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749184 00000100:00100000:1.0:1777580317.144343:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749184 00000100:00100000:1.0:1777580317.144353:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749440 00000100:00100000:1.0:1777580317.144356:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749440 00000100:00100000:1.0:1777580317.144365:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749568 00000100:00100000:1.0:1777580317.144367:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749568 00000100:00100000:1.0:1777580317.144377:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917478656 00000100:00100000:1.0:1777580317.144380:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917478656 00000100:00100000:1.0:1777580317.144389:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479168 00000100:00100000:1.0:1777580317.144391:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479168 00000100:00100000:1.0:1777580317.144412:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479680 00000100:00100000:1.0:1777580317.144415:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479680 00000100:00100000:1.0:1777580317.144430:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917480192 00000100:00100000:1.0:1777580317.144432:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917480192 00000100:00100000:1.0:1777580317.144441:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917478784 00000100:00100000:1.0:1777580317.144444:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917478784 00000100:00100000:1.0:1777580317.144453:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479296 00000100:00100000:1.0:1777580317.144456:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479296 00000100:00100000:1.0:1777580317.144464:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479808 00000100:00100000:1.0:1777580317.144466:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479808 00000100:00100000:1.0:1777580317.144474:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917480320 00000100:00100000:1.0:1777580317.144476:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917480320 00000100:00100000:1.0:1777580317.144483:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917478912 00000100:00100000:1.0:1777580317.144486:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917478912 00000100:00100000:1.0:1777580317.144494:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479424 00000100:00100000:1.0:1777580317.144496:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479424 00000100:00100000:1.0:1777580317.144506:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479936 00000100:00100000:1.0:1777580317.144508:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479936 00000100:00100000:1.0:1777580317.144516:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917480448 00000100:00100000:1.0:1777580317.144518:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917480448 00000100:00100000:1.0:1777580317.144534:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12043 00000100:00100000:1.0:1777580317.144543:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3291:x1863919917478528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.144586:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5532 count 1 00010000:00010000:1.0:1777580317.144665:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.144693:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.144703:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.144705:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.144709:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.144757:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.144775:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.144799:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917480576:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.145064:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12044 00000100:00100000:3.0:1777580317.145078:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2361:x1863919946748800:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580317.146458:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.146525:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917479552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.146560:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.146572:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917480064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.146593:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.146646:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479040 00000100:00100000:0.0:1777580317.146654:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479040 00000100:00100000:0.0:1777580317.146689:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917479552 00000100:00100000:0.0:1777580317.146692:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917479552 00000100:00100000:0.0:1777580317.146705:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917480064 00000100:00100000:0.0:1777580317.146707:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917480064 00000100:00100000:0.0:1777580317.146725:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12045 00000100:00100000:0.0:1777580317.146736:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946748928:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.146753:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.146781:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec25 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580317.146821:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c9:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:0.0:1777580317.146839:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.146841:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.146851:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 33 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.146874:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 33 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.146890:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b4600, rc 0) 00000100:00100000:1.0:1777580317.147011:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0238900a300 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.147038:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12046 00000100:00100000:1.0:1777580317.147050:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946749056:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.147060:0:205896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.147075:0:205896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec2c expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580317.147094:0:205896:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ed:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:1.0:1777580317.147122:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.147124:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.147129:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 35 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.147160:0:205896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 35 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.147170:0:205896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b638f400, rc 0) 00000100:00100000:3.0:1777580317.148898:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946748800:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3810us (9098us total) trans 8589939039 rc 0/0 00000100:00100000:3.0:1777580317.148915:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12044 00000100:00100000:3.0:1777580317.148963:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12047 00000100:00100000:3.0:1777580317.148981:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2361:x1863919946749184:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.148999:0:188247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.149028:0:188247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec33 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580317.149076:0:188247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ca:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580317.149116:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149119:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149128:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 34 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149164:0:188247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 34 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149178:0:188247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7400, rc 0) 00000100:00100000:3.0:1777580317.149236:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2361:x1863919946749184:12345-192.168.202.9@tcp:101:rm.500 Request processed in 265us (9277us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.149243:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12047 00000100:00100000:3.0:1777580317.149260:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12048 00000100:00100000:3.0:1777580317.149268:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946749440:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.149276:0:188247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.149339:0:188247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec41 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580317.149354:0:188247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15c8:0x0] initial LVB size: 0, mtime: 0x69f3b91b, atime: 0x69f3b91b, ctime: 0x69f3b91b, blocks: 0x1 00010000:00010000:3.0:1777580317.149363:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149365:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149370:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 34 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149397:0:188247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 34 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149407:0:188247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de7800, rc 0) 00000100:00100000:3.0:1777580317.149430:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946749440:12345-192.168.202.9@tcp:101:rm.500 Request processed in 163us (9452us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.149437:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12048 00000100:00100000:3.0:1777580317.149453:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12049 00000100:00100000:3.0:1777580317.149461:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946749568:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.149470:0:188247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.149483:0:188247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec48 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580317.149500:0:188247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ee:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580317.149509:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149510:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149514:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 35 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149526:0:188247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 35 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149534:0:188247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6800, rc 0) 00000100:00100000:3.0:1777580317.149554:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2364:x1863919946749568:12345-192.168.202.9@tcp:101:rm.500 Request processed in 95us (9558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.149567:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12049 00000100:00100000:3.0:1777580317.149583:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12050 00000100:00100000:3.0:1777580317.149591:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917478656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.149613:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5533 count 1 00010000:00010000:3.0:1777580317.149632:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149649:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 32 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149657:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149658:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149660:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149702:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 32 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149716:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.149732:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917480704:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.149798:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b7d42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.149834:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12051 00000100:00100000:3.0:1777580317.149843:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917479168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.149867:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5539 count 1 00010000:00010000:3.0:1777580317.149882:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149896:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 33 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149902:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149903:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.149905:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149926:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 33 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.149937:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 33 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.149948:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917480832:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.149969:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1300 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.149990:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12052 00000100:00100000:3.0:1777580317.150000:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917479680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580317.150015:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5571 count 1 00010000:00010000:3.0:1777580317.150030:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150054:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 30 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150061:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150063:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150066:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150089:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 30 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150101:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.150112:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917480960:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.150161:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.150181:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12053 00000100:00100000:3.0:1777580317.150191:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917480192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580317.150207:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5576 count 1 00010000:00010000:3.0:1777580317.150220:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150232:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 34 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150254:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150256:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150259:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150281:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 34 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150290:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 34 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.150299:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917481088:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.150318:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023846e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.150334:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12054 00000100:00100000:3.0:1777580317.150342:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917478784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.150354:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5536 count 1 00010000:00010000:3.0:1777580317.150393:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150407:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 32 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150414:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150415:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150426:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150446:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 32 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150455:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.150465:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917481216:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.150486:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023846e3900 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.150506:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12055 00000100:00100000:3.0:1777580317.150515:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917479296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.150529:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5538 count 1 00010000:00010000:3.0:1777580317.150543:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150556:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 33 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150563:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150564:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.150567:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150587:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 33 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.150609:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 33 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.150619:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917481344:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.150641:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02392bc9240 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.153406:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946748928:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6651us (13496us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.153445:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12045 00000100:00100000:0.0:1777580317.153506:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1777580317.153521:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917479808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.153562:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5570 count 1 00010000:00010000:0.0:1777580317.153595:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.153621:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 30 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.153631:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.153634:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.153637:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.153686:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 30 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.153701:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.153717:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917481472:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.153815:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.153963:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12057 00000100:00100000:0.0:1777580317.153973:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917480320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.153999:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5575 count 1 00010000:00010000:0.0:1777580317.154011:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154024:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154032:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.154033:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.154036:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154058:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154069:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.154079:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917481600:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.154120:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.154169:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749312 00000100:00100000:0.0:1777580317.154178:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749312 00000100:00100000:0.0:1777580317.154221:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838068448790 time 7838069820401 state 0x0 ref 1 00000100:00100000:0.0:1777580317.154234:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838069920401 time 7838069820401 state 0x1 ref 1 00000100:00100000:0.0:1777580317.154254:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749824 00000100:00100000:0.0:1777580317.154265:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749824 00000100:00100000:0.0:1777580317.154282:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838069920401 time 7838069820401 state 0x1 ref 2 00000100:00100000:0.0:1777580317.154305:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103267778 time 7838103167778 state 0x1 ref 2 00000100:00100000:0.0:1777580317.154314:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+69:283414:x1863919946749312:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.154334:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.154356:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4ca63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec3a expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154424:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4ca63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x837:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec3a expref: 70 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154441:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4ca63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x837:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec3a expref: 70 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154464:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa02486090900) 00010000:00010000:0.0:1777580317.154467:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.154470:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5600, rc 0) 00000100:00100000:0.0:1777580317.154497:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+70:283414:x1863919946749312:12345-192.168.202.9@tcp:101:touch.500 Request processed in 183us (14562us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.154504:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19792 00000100:00100000:0.0:1777580317.154521:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103267778 time 7838103384352 state 0x0 ref 1 00000100:00100000:0.0:1777580317.154529:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+69:283416:x1863919946749824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.154537:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.154546:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4ca6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec4f expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154713:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154725:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154734:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154749:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154755:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.154762:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.155403:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f1:0x0], index 0: 0 00010000:00010000:0.0:1777580317.155621:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4ca7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155634:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155643:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155689:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155709:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155716:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155722:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.155726:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155734:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155747:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.155749:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.155753:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155760:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4ca71 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.155782:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac90614e reply state 0000000097c2893a transno 8589950960 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.155804:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.155847:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4800/0xcb2b2f2f7e4ca6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec4f expref: 72 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155862:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec4f expref: 71 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.155881:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa02486090400) 00010000:00010000:0.0:1777580317.155883:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.155886:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a69bec00, rc 0) 00000100:00100000:0.0:1777580317.155934:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283416:x1863919946749824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1405us (13342us total) trans 8589950960 rc 0/0 00000100:00100000:0.0:1777580317.155942:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19793 00000100:00100000:0.0:1777580317.155948:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103267778 time 7838103384352 state 0x2 ref 0 00000100:00100000:0.0:1777580317.156006:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12058 00000100:00100000:0.0:1777580317.156020:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917478912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580317.156045:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5535 count 1 00010000:00010000:0.0:1777580317.156066:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156083:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 32 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156109:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156112:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156115:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156188:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 32 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156216:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 32 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.156232:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917481728:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.156287:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f000 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.156310:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12059 00000100:00100000:0.0:1777580317.156319:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917479424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580317.156333:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5540 count 1 00010000:00010000:0.0:1777580317.156345:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156359:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156366:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156367:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156369:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156391:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156401:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.156426:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917481856:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.156446:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.156466:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12060 00000100:00100000:0.0:1777580317.156475:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917479936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.156492:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5572 count 1 00010000:00010000:0.0:1777580317.156508:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156521:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156528:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156529:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156532:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156551:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156562:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.156574:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917481984:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.156594:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239556f540 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.156626:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12061 00000100:00100000:0.0:1777580317.156635:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917480448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.156649:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5574 count 1 00010000:00010000:0.0:1777580317.156663:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156676:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156682:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156683:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.156686:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156706:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.156716:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.156726:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917482112:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.156747:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.163608:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946749056:12345-192.168.202.9@tcp:101:rm.500 Request processed in 16539us (23673us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.163627:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12046 00000100:00100000:1.0:1777580317.163688:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12062 00000100:00100000:1.0:1777580317.163707:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917479040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.163749:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5534 count 1 00010000:00010000:1.0:1777580317.165090:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165126:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 32 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165156:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165159:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165163:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165228:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 32 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165243:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 32 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.165262:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917482240:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.165361:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389543900 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.165411:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12063 00000100:00100000:1.0:1777580317.165450:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917479552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.165482:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5569 count 1 00010000:00010000:1.0:1777580317.165511:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165524:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 30 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165531:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165533:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165535:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165554:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 30 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165563:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 30 pid: 188246 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.165574:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917482368:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.165601:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023895439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.165648:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12064 00000100:00100000:1.0:1777580317.165656:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917480064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.165671:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5573 count 1 00010000:00010000:1.0:1777580317.165685:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165710:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 30 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165716:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165718:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.165720:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165741:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 30 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.165751:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.165762:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917482496:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.165796:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02498b7a600 going to sleep for 11 seconds 00000100:00080000:1.0:1777580317.165829:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777580317.165835:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777580317.173745:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.173827:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174067:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174088:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174234:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174254:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.174380:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917480704:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.174414:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174453:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917480832:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.174467:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174496:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750080 00000100:00100000:3.0:1777580317.174503:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750080 00010000:00010000:3.0:1777580317.174547:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 33 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174604:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946749952 00000100:00100000:3.0:1777580317.174608:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946749952 00010000:00010000:3.0:1777580317.174623:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 33 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174634:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750336 00000100:00100000:3.0:1777580317.174637:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750336 00010000:00010000:3.0:1777580317.174650:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174661:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750592 00000100:00100000:3.0:1777580317.174663:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750592 00010000:00010000:3.0:1777580317.174676:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 34 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174686:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750208 00000100:00100000:3.0:1777580317.174688:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750208 00010000:00010000:3.0:1777580317.174713:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 31 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174724:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750464 00000100:00100000:3.0:1777580317.174726:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750464 00010000:00010000:3.0:1777580317.174736:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 34 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174745:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750720 00000100:00100000:3.0:1777580317.174753:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750720 00010000:00010000:3.0:1777580317.174766:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 32 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.174782:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4410 00000100:00100000:3.0:1777580317.174805:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2363:x1863919946750080:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.174821:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.174826:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.174840:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.174868:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4a461 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e326 expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.174886:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.174889:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.174894:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.174904:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.174933:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.174993:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2363:x1863919946750080:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 190us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.175012:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4410 00000100:00100000:3.0:1777580317.175034:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4411 00000100:00100000:3.0:1777580317.175041:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2363:x1863919946749952:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.175049:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.175053:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 34 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.175064:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 34 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.175078:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b456e1e0/0xcb2b2f2f7e49e5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e197 expref: 34 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.175089:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.175091:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.175094:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.175911:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917481984:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.175945:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.175980:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917481856:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.175992:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.176032:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917481728:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.176045:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.176069:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917481600:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.176080:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.176255:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917481472:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.176270:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.177319:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4412 00000100:00100000:0.0:1777580317.177340:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2363:x1863919946750336:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.177363:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.177372:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177387:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177413:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4a45a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e31f expref: 34 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177430:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177432:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177438:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177449:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177491:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.177558:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2363:x1863919946750336:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 226us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.177567:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4412 00000100:00100000:0.0:1777580317.177614:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4413 00000100:00100000:0.0:1777580317.177622:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2363:x1863919946750592:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.177632:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.177638:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177650:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177663:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4a4ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e357 expref: 32 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177675:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177676:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177680:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177688:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177705:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.177723:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2363:x1863919946750592:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 104us (3635us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.177730:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4413 00000100:00100000:0.0:1777580317.177742:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4414 00000100:00100000:0.0:1777580317.177748:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2363:x1863919946750208:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.177778:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.177792:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177803:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177817:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4a0b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e23f expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177827:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177828:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177831:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177840:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177857:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.177875:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2363:x1863919946750208:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 127us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.177880:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4414 00000100:00100000:0.0:1777580317.177893:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4415 00000100:00100000:0.0:1777580317.177900:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2363:x1863919946750464:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.177907:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.177913:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 33 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177930:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 33 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177943:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4a0e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e269 expref: 33 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177955:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177956:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.177959:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177968:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.177982:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.177998:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2363:x1863919946750464:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 99us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.178003:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4415 00000100:00100000:0.0:1777580317.178015:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4416 00000100:00100000:0.0:1777580317.178021:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2363:x1863919946750720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.178028:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.178034:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178055:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178068:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4a0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e262 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178078:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.178080:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.178083:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178091:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178312:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.178330:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2363:x1863919946750720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 308us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.178336:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4416 00010000:00010000:0.0:1777580317.178374:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178383:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178391:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178408:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.178414:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178422:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178434:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02486090600) 00010000:00010000:0.0:1777580317.178438:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.178442:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178449:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4ca78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178486:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178494:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178504:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178512:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.178532:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.178922:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.178933:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.178942:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.178948:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.178966:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580317.179249:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580317.179259:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179268:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.179272:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179279:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179294:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179302:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4ca55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179324:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.179328:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179334:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.179336:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179356:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179366:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179373:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4ca5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.179390:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.179392:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.179393:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.180710:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917480320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26732us (36698us total) trans 8589939040 rc 0/0 00000100:00100000:1.0:1777580317.180735:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12057 00010000:00010000:3.0:1777580317.183583:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.183646:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.183915:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2363:x1863919946749952:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 8866us (10079us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.183928:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4411 00000100:00080000:3.0:1777580317.184052:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777580317.184073:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.184084:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.184428:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.184439:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.184465:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.184913:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.184924:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.184934:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.184941:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.184959:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580317.186594:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917479168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36745us (42869us total) trans 8589938640 rc 0/0 00000100:00100000:3.0:1777580317.186608:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12051 00010000:00010000:3.0:1777580317.186684:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.186700:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.186711:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.186720:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187259:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187276:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187286:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187294:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187323:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1777580317.187548:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187559:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187567:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187574:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.187582:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1777580317.187999:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917479936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31522us (43833us total) trans 8589939041 rc 0/0 00000100:00100000:1.0:1777580317.188010:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12060 00010000:00010000:1.0:1777580317.188045:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1777580317.188053:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.188062:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.188067:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.188090:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.188873:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777580317.189268:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189283:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ca32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189314:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777580317.189320:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189327:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.189331:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189340:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189350:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189358:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4ca94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189390:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580317.189394:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189401:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.189404:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189412:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189422:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189429:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4ca2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189445:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580317.189449:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189455:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.189458:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189476:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189486:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189491:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4ca8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189506:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.189510:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189517:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.189520:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189527:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189537:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189544:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6404067/0xcb2b2f2f7e4ca9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.189569:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.189571:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.189573:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.190046:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917479808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36526us (46081us total) trans 8589939042 rc 0/0 00000100:00100000:0.0:1777580317.190057:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12056 00000100:00100000:3.0:1777580317.190508:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917478656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40916us (46902us total) trans 8589938641 rc 0/0 00000100:00100000:3.0:1777580317.190516:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12050 00000100:00100000:3.0:1777580317.190773:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.190877:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.190901:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.190925:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.190943:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.193180:0:3288:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589939008 gen 2 00000004:00080000:1.0:1777580317.193194:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a1f80, transno 8589938970 00000004:00080000:1.0:1777580317.193210:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a2a00, transno 8589938971 00000004:00080000:1.0:1777580317.193213:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a0700, transno 8589938972 00000004:00080000:1.0:1777580317.193216:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a0a80, transno 8589938973 00000004:00080000:1.0:1777580317.193218:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a1880, transno 8589938974 00000004:00080000:1.0:1777580317.193221:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a1180, transno 8589938975 00000004:00080000:1.0:1777580317.193224:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a1c00, transno 8589938976 00000004:00080000:1.0:1777580317.193226:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ed80, transno 8589938977 00000004:00080000:1.0:1777580317.193228:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1f480, transno 8589938978 00000004:00080000:1.0:1777580317.193231:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ac337100, transno 8589938979 00000004:00080000:1.0:1777580317.193234:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f800, transno 8589938980 00000004:00080000:1.0:1777580317.193236:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ed80, transno 8589938981 00000004:00080000:1.0:1777580317.193239:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde3800, transno 8589938982 00000004:00080000:1.0:1777580317.193242:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aeeb8380, transno 8589938983 00000004:00080000:1.0:1777580317.193244:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a3100, transno 8589938984 00000004:00080000:1.0:1777580317.193247:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1671c00, transno 8589938985 00000004:00080000:1.0:1777580317.193250:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfb480, transno 8589938986 00000004:00080000:1.0:1777580317.193265:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0238e369500, transno 8589938987 00000004:00080000:1.0:1777580317.193268:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae4b5c00, transno 8589938988 00000004:00080000:1.0:1777580317.193270:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0238e36bb80, transno 8589938989 00000004:00080000:1.0:1777580317.193273:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1673800, transno 8589938990 00000004:00080000:1.0:1777580317.193275:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfb100, transno 8589938991 00000004:00080000:1.0:1777580317.193278:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7df8380, transno 8589938992 00000004:00080000:1.0:1777580317.193304:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c2300, transno 8589938993 00000004:00080000:1.0:1777580317.193308:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef92300, transno 8589938994 00000004:00080000:1.0:1777580317.193311:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae685c00, transno 8589938995 00000004:00080000:1.0:1777580317.193314:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde0e00, transno 8589938996 00000004:00080000:1.0:1777580317.193317:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985faa00, transno 8589938997 00000004:00080000:1.0:1777580317.193320:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985f9500, transno 8589938998 00000004:00080000:1.0:1777580317.193323:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef93800, transno 8589938999 00000004:00080000:1.0:1777580317.193326:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aec3c700, transno 8589939000 00000004:00080000:1.0:1777580317.193329:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55fbb80, transno 8589939001 00000004:00080000:1.0:1777580317.193332:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aec3f100, transno 8589939002 00000004:00080000:1.0:1777580317.193335:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aec3b480, transno 8589939003 00000004:00080000:1.0:1777580317.193338:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02393dea300, transno 8589939004 00000004:00080000:1.0:1777580317.193341:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30dc00, transno 8589939005 00000100:00100000:1.0:1777580317.193372:0:3288:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa024ae6aed80 x1863919917480320/t8589939040(8589939040) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580333 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777580317.193388:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae6aed80/2, rc 0, transno 8589939040 00000100:00100000:1.0:1777580317.193395:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917480320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.193443:0:3288:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589938610 gen 2 00000004:00080000:1.0:1777580317.193446:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095c380, transno 8589938569 00000004:00080000:1.0:1777580317.193457:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d180, transno 8589938570 00000004:00080000:1.0:1777580317.193460:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095c700, transno 8589938571 00000004:00080000:1.0:1777580317.193462:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d500, transno 8589938572 00000004:00080000:1.0:1777580317.193465:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ca80, transno 8589938573 00000004:00080000:1.0:1777580317.193468:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a3480, transno 8589938574 00000004:00080000:1.0:1777580317.193470:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095fb80, transno 8589938575 00000004:00080000:1.0:1777580317.193473:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a0000, transno 8589938576 00000004:00080000:1.0:1777580317.193476:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1e300, transno 8589938577 00000004:00080000:1.0:1777580317.193478:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1c000, transno 8589938578 00000004:00080000:1.0:1777580317.193480:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1d500, transno 8589938579 00000004:00080000:1.0:1777580317.193493:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef33b80, transno 8589938580 00000004:00080000:1.0:1777580317.193496:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1df80, transno 8589938581 00000004:00080000:1.0:1777580317.193499:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde0000, transno 8589938582 00000004:00080000:1.0:1777580317.193502:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02397d5df80, transno 8589938583 00000004:00080000:1.0:1777580317.193505:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ad9c4000, transno 8589938584 00000004:00080000:1.0:1777580317.193508:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7df9180, transno 8589938585 00000004:00080000:1.0:1777580317.193511:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfb800, transno 8589938586 00000004:00080000:1.0:1777580317.193513:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfa680, transno 8589938587 00000004:00080000:1.0:1777580317.193516:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235d180, transno 8589938588 00000004:00080000:1.0:1777580317.193518:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1672680, transno 8589938589 00000004:00080000:1.0:1777580317.193521:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1670a80, transno 8589938590 00000004:00080000:1.0:1777580317.193524:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1673480, transno 8589938591 00000004:00080000:1.0:1777580317.193526:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7df9c00, transno 8589938592 00000004:00080000:1.0:1777580317.193529:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f100, transno 8589938593 00000004:00080000:1.0:1777580317.193531:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1672d80, transno 8589938594 00000004:00080000:1.0:1777580317.193534:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985f9880, transno 8589938596 00000004:00080000:1.0:1777580317.193537:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249f2b8000, transno 8589938597 00000004:00080000:1.0:1777580317.193540:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a3b80, transno 8589938598 00000004:00080000:1.0:1777580317.193542:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985fb100, transno 8589938599 00000004:00080000:1.0:1777580317.193545:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985fa680, transno 8589938600 00000004:00080000:1.0:1777580317.193548:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985f8e00, transno 8589938601 00000004:00080000:1.0:1777580317.193551:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a3800, transno 8589938602 00000100:00100000:1.0:1777580317.193581:0:3288:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa023850c4380 x1863919917478656/t8589938641(8589938641) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580333 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777580317.193588:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c4380/2, rc 0, transno 8589938641 00000100:00100000:1.0:1777580317.193593:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917478656:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.193609:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c4700/2, rc 0, transno 8589938640 00000100:00100000:1.0:1777580317.193613:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479168:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.193646:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02484c10a80/2, rc 0, transno 8589939042 00000100:00100000:1.0:1777580317.193650:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02484c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580317.193676:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580317.193699:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae4b6d80/2, rc 0, transno 8589939041 00000100:00100000:1.0:1777580317.193704:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917479936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.193736:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917480576:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.193773:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.193819:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750848 00000100:00100000:1.0:1777580317.193827:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750848 00000100:00100000:1.0:1777580317.193884:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12065 00000100:00100000:1.0:1777580317.193894:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946750848:12345-192.168.202.9@tcp:2:touch.500 00000004:00080000:1.0:1777580317.194461:0:187652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 35 changes, 8 in progress, 5 in flight, 36 done 00000004:00080000:1.0:1777580317.194744:0:187654:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 35 changes, 8 in progress, 6 in flight, 33 done 00000100:00100000:1.0:1777580317.194814:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917482624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.194897:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.194931:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917483136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.194952:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.194976:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580317.194981:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917483008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.195000:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.195026:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917482880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.195049:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.195086:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777580317.195092:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917482752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.195111:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.195169:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917482624 00000100:00100000:1.0:1777580317.195175:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917482624 00000100:00100000:1.0:1777580317.195210:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917483136 00000100:00100000:1.0:1777580317.195213:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917483136 00000100:00100000:1.0:1777580317.195231:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917483008 00000100:00100000:1.0:1777580317.195234:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917483008 00000100:00100000:1.0:1777580317.195246:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917482880 00000100:00100000:1.0:1777580317.195249:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917482880 00000100:00100000:1.0:1777580317.195258:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917482752 00000100:00100000:1.0:1777580317.195260:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917482752 00000100:00100000:1.0:1777580317.195270:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12066 00000100:00100000:1.0:1777580317.195278:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917482624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.195303:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5581 count 1 00010000:00010000:1.0:1777580317.195334:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.195358:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.195366:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.195369:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.195373:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.195405:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 32 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.195429:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 32 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.195443:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917483264:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.195517:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.195537:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12067 00000100:00100000:1.0:1777580317.195545:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917483136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.195560:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5546 count 1 00000100:00100000:3.0:1777580317.197571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.197909:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.197939:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.198004:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.198050:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.198391:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12068 00000100:00100000:1.0:1777580317.198413:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917483008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.198457:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5537 count 1 00010000:00010000:1.0:1777580317.198486:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198513:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 31 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198523:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.198525:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.198530:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198579:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 31 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198615:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 31 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.198633:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917483392:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.198728:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.198767:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12069 00000100:00100000:1.0:1777580317.198778:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917482880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.198807:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5577 count 1 00010000:00010000:1.0:1777580317.198825:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198839:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 32 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198845:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.198847:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.198850:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198870:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 32 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.198880:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 32 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.198906:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917483520:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.198934:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.198956:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752000 00000100:00100000:1.0:1777580317.198964:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752000 00000100:00100000:1.0:1777580317.199021:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4237 00000100:00100000:1.0:1777580317.199028:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+71:283410:x1863919946752000:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580317.199455:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+72:283410:x1863919946752000:12345-192.168.202.9@tcp:35:touch.500 Request processed in 424us (1511us total) trans 8589950961 rc 0/0 00000100:00100000:1.0:1777580317.199463:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4237 00000100:00100000:1.0:1777580317.199520:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917482240:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.199546:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.199582:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917482368:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.199596:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.199644:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917482496:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.199658:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.199682:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12070 00000100:00100000:1.0:1777580317.199704:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917482752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.199722:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5579 count 1 00010000:00010000:1.0:1777580317.199740:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199756:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 32 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199762:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.199764:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.199767:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199807:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 32 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199818:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 32 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.199830:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917483648:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.199864:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0238900a300 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.199911:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199924:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 31 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199942:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.199943:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.199946:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199964:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 31 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.199973:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 31 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.199984:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917483776:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.200009:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02498b7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.201831:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946750976 00000100:00100000:0.0:1777580317.201850:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946750976 00010000:00010000:0.0:1777580317.201914:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 31 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.201983:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946751232 00000100:00100000:0.0:1777580317.201987:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946751232 00010000:00010000:0.0:1777580317.202005:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 33 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.202016:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946751488 00000100:00100000:0.0:1777580317.202019:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946751488 00010000:00010000:0.0:1777580317.202033:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 32 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.202043:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946751104 00000100:00100000:0.0:1777580317.202046:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946751104 00010000:00010000:0.0:1777580317.202062:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.202073:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946751360 00000100:00100000:0.0:1777580317.202076:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946751360 00010000:00010000:0.0:1777580317.202089:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 32 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.202117:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4417 00000100:00100000:0.0:1777580317.202167:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2362:x1863919946750976:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.202184:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.202191:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202207:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202238:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e49df4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e17b expref: 32 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202260:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202263:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202269:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202281:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202327:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.202398:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2362:x1863919946750976:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 234us (11520us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.202407:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4417 00000100:00100000:0.0:1777580317.202447:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4418 00000100:00100000:0.0:1777580317.202454:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946751232:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.202463:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.202476:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 33 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202488:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 33 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202503:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202506:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202509:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202518:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202531:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.202551:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946751232:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 98us (11650us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.202558:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4418 00000100:00100000:0.0:1777580317.202606:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4419 00000100:00100000:0.0:1777580317.202613:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946751488:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.202620:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.202625:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 32 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202636:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 32 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202661:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202663:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202666:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202674:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202686:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.202709:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946751488:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 96us (11782us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.202715:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4419 00000100:00100000:0.0:1777580317.202729:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4420 00000100:00100000:0.0:1777580317.202734:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2362:x1863919946751104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.202742:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.202746:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202757:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202771:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202772:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202775:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202808:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202821:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.202843:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2362:x1863919946751104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 107us (11897us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.202848:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4420 00000100:00100000:0.0:1777580317.202862:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4421 00000100:00100000:0.0:1777580317.202868:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946751360:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.202875:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.202880:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202890:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202903:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202905:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.202908:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202915:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.202927:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.202952:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946751360:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 84us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.202959:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4421 00000100:00100000:0.0:1777580317.203034:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917482112:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.203055:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.203374:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.203386:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.203398:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.203407:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.203489:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.206642:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.206680:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.206722:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.206927:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917478528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62380us (74215us total) trans 8589938642 rc 0/0 00000100:00100000:0.0:1777580317.206944:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12043 00000100:00100000:3.0:1777580317.207338:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.207449:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.207462:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.207480:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.207486:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.207500:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.207529:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.207557:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4ca01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.207585:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.207587:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.207589:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580317.207651:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c5f80/2, rc 0, transno 8589938642 00000100:00100000:1.0:1777580317.207671:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917478528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.207708:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917483264:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.207734:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.208214:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.208229:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.208241:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.208287:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.208333:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.208895:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3290:x1863919917479424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52575us (64800us total) trans 8589938643 rc 0/0 00000100:00100000:3.0:1777580317.208908:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12059 00010000:00010000:3.0:1777580317.208963:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.209004:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4a0be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e246 expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.209023:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917480960:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.209047:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209058:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209065:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209076:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209084:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209104:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.209497:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917479680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59497us (65726us total) trans 8589939043 rc 0/0 00000100:00100000:3.0:1777580317.209504:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12052 00010000:00010000:3.0:1777580317.209554:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a57605e/0xcb2b2f2f7e4a7e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e461 expref: 32 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.209583:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917481088:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.209600:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209608:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209616:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209624:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209631:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.209645:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580317.209927:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917480192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59737us (66105us total) trans 8589939044 rc 0/0 00000100:00100000:3.0:1777580317.209934:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12053 00010000:00010000:3.0:1777580317.209974:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4a0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e24d expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.209989:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917481216:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.210013:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210021:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210028:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210036:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210042:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210059:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1777580317.210367:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917478784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60025us (66489us total) trans 8589938644 rc 0/0 00000100:00100000:3.0:1777580317.210374:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12054 00010000:00010000:3.0:1777580317.210413:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903e3047/0xcb2b2f2f7e4a453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e318 expref: 31 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.210426:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917481344:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.210442:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210463:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210470:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210478:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210484:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.210496:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1777580317.210751:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917479296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60237us (66841us total) trans 8589938645 rc 0/0 00000100:00100000:3.0:1777580317.210758:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12055 00000100:00100000:3.0:1777580317.210953:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752384 00000100:00100000:3.0:1777580317.210963:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752384 00010000:00010000:3.0:1777580317.211005:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 32 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211027:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752640 00000100:00100000:3.0:1777580317.211030:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752640 00010000:00010000:3.0:1777580317.211044:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 28 pid: 188246 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211071:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752512 00000100:00100000:3.0:1777580317.211074:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752512 00010000:00010000:3.0:1777580317.211091:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211102:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752768 00000100:00100000:3.0:1777580317.211104:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752768 00010000:00010000:3.0:1777580317.211117:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211127:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752896 00000100:00100000:3.0:1777580317.211130:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752896 00010000:00010000:3.0:1777580317.211173:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 33 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211186:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753024 00000100:00100000:3.0:1777580317.211190:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753024 00010000:00010000:3.0:1777580317.211203:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 31 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211214:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753280 00000100:00100000:3.0:1777580317.211218:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753280 00010000:00010000:3.0:1777580317.211229:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 34 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211240:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753152 00000100:00100000:3.0:1777580317.211249:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753152 00010000:00010000:3.0:1777580317.211263:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 35 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211275:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753408 00000100:00100000:3.0:1777580317.211278:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753408 00010000:00010000:3.0:1777580317.211290:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 32 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.211304:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4422 00000100:00100000:3.0:1777580317.211314:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946752384:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.211330:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.211337:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 35 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211350:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 35 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211379:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b48b1cd/0xcb2b2f2f7e4a468 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e32d expref: 35 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211398:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211400:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211406:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211418:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211465:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.211517:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2361:x1863919946752384:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 205us (13465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.211525:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4422 00000100:00100000:3.0:1777580317.211542:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4423 00000100:00100000:3.0:1777580317.211548:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946752640:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.211556:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.211560:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 29 pid: 188246 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211570:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 29 pid: 188246 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211584:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000916d3747/0xcb2b2f2f7e49e1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e189 expref: 29 pid: 188246 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211596:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211597:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211601:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211608:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211630:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.211654:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946752640:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 107us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.211661:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4423 00000100:00100000:3.0:1777580317.211675:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4424 00000100:00100000:3.0:1777580317.211682:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946752512:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.211690:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.211695:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211706:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211720:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4a0cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x159e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e254 expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211732:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211734:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.211737:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211744:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.211762:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.211780:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946752512:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 99us (5100us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.217412:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4424 00000100:00100000:3.0:1777580317.217586:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4425 00000100:00100000:3.0:1777580317.217606:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2361:x1863919946752768:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.217635:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.217647:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 27 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.217671:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 27 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.217703:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f4e4a51/0xcb2b2f2f7e4a0d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e25b expref: 27 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.217727:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.217730:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.217737:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.217750:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.217816:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.217893:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2361:x1863919946752768:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 297us (11168us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.217900:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4425 00000100:00100000:3.0:1777580317.217959:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4426 00000100:00100000:3.0:1777580317.217967:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946752896:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.217986:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.217993:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 33 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.218006:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 33 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.218020:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4a69f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e3d5 expref: 33 pid: 206020 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.218031:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.218032:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.218036:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.218044:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.218068:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.218266:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4427 00010000:00010000:1.0:1777580317.218294:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.218303:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.218314:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.218323:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.218352:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1777580317.219667:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946752896:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1688us (12317us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.219683:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4426 00000100:00100000:3.0:1777580317.219730:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4428 00000100:00100000:3.0:1777580317.219748:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946753280:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.219765:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.219774:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 31 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.219813:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 31 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.219840:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.219842:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.219847:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.219857:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.219881:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.219934:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946753280:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 196us (11703us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.219940:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4428 00000100:00100000:3.0:1777580317.219956:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4429 00000100:00100000:3.0:1777580317.219964:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946753152:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.219972:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.219977:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 30 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.219987:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 30 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.220012:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.220013:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.220016:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.220024:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.220037:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.220057:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946753152:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 94us (11814us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.220063:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4429 00000100:00100000:3.0:1777580317.220077:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4430 00000100:00100000:1.0:1777580317.220904:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3291:x1863919917480064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55244us (74305us total) trans 8589939045 rc 0/0 00000100:00100000:1.0:1777580317.220915:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12064 00000100:00100000:1.0:1777580317.221062:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917483392:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.221089:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221168:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008da66927/0xcb2b2f2f7e4a7cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e430 expref: 29 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.221184:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917483520:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.221198:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221207:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221214:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221225:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221247:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.221260:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1777580317.222689:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946753408:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.222733:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.222749:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 32 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.222770:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 32 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.222817:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.222819:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.222826:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.222858:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.222890:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.223230:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946753408:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3142us (14938us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.223244:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4430 00000100:00100000:1.0:1777580317.224001:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+16:3289:x1863919917482880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25220us (28945us total) trans 8589939046 rc 0/0 00000100:00100000:1.0:1777580317.224012:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12069 00010000:00010000:1.0:1777580317.224085:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c13df077/0xcb2b2f2f7e4a7c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e43e expref: 28 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.224116:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917483648:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.224171:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.224183:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.224191:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.224203:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.224212:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.224236:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1777580317.226023:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946751744 00000100:00100000:3.0:1777580317.226042:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946751744 00000100:00100000:3.0:1777580317.226100:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103267778 time 7838103384352 state 0x0 ref 1 00000100:00100000:3.0:1777580317.226117:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103484352 time 7838103384352 state 0x1 ref 1 00000100:00100000:3.0:1777580317.226161:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946752256 00000100:00100000:3.0:1777580317.226165:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946752256 00000100:00100000:3.0:1777580317.226177:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838103484352 time 7838103384352 state 0x1 ref 2 00000100:00100000:3.0:1777580317.226202:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838175164697 time 7838175064697 state 0x1 ref 2 00000100:00100000:3.0:1777580317.226218:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+73:283415:x1863919946751744:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580317.226245:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.226272:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4cae1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec56 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226468:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226509:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226521:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226539:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226546:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.226552:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580317.227298:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15cd:0x0], index 1: 0 00010000:00010000:3.0:1777580317.227520:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4caf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227533:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4caf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227543:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4caf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227588:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227595:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227602:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227621:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.227626:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227632:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227646:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.227648:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.227653:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227658:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4cae8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.227674:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000027becf9e reply state 00000000fc8a96ba transno 8589950962 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.227683:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580317.227724:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4cae1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec56 expref: 76 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227739:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4caf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec56 expref: 75 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.227747:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa02497a21d00) 00010000:00010000:3.0:1777580317.227750:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.227752:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86a00, rc 0) 00000100:00100000:1.0:1777580317.231765:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1863919917482752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32048us (36637us total) trans 8589939047 rc 0/0 00000100:00100000:1.0:1777580317.234367:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12070 00010000:00010000:1.0:1777580317.234507:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067f5c9e5/0xcb2b2f2f7e4ac95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4fb expref: 31 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.234533:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917483776:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.234566:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.234579:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.234586:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.234597:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.234607:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.234627:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1777580317.235666:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283415:x1863919946751744:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9445us (37748us total) trans 8589950962 rc 0/0 00000100:00100000:3.0:1777580317.235692:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19794 00000100:00100000:3.0:1777580317.235735:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838175164697 time 7838184594454 state 0x0 ref 1 00000100:00100000:3.0:1777580317.235757:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+75:283416:x1863919946752256:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580317.235848:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.235882:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a69bec00/0xcb2b2f2f7e4ca7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec4f expref: 75 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.235905:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa02486090400) 00010000:00010000:3.0:1777580317.235920:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.236058:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.236075:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.236086:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.237513:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917483136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41960us (42551us total) trans 8589938646 rc 0/0 00000100:00100000:1.0:1777580317.237528:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12067 00000100:00100000:1.0:1777580317.237904:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3290:x1863919917478912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 81888us (93843us total) trans 8589938647 rc 0/0 00000100:00100000:1.0:1777580317.237911:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12058 00000004:00080000:1.0:1777580317.237973:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c7100/2, rc 0, transno 8589938647 00000100:00100000:1.0:1777580317.237986:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917478912:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.237997:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffdc00/2, rc 0, transno 8589938643 00000100:00100000:1.0:1777580317.238001:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917479424:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580317.238022:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1777580317.238033:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.238047:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.238053:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.238065:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.238666:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005387bc69 reply state 00000000432e0336 transno 8589950963 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.238678:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580317.238783:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283416:x1863919946752256:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3033us (40776us total) trans 8589950963 rc 0/0 00000100:00100000:3.0:1777580317.238805:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19795 00000100:00100000:3.0:1777580317.238813:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838175164697 time 7838184594454 state 0x2 ref 0 00010000:00010000:3.0:1777580317.238924:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1777580317.238931:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.238940:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.238943:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.238952:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.238968:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.238975:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4ca40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239001:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1777580317.239006:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239013:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.239016:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239023:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239041:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239047:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4ca47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239063:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1777580317.239068:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239075:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.239077:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.239085:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239304:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239330:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239340:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239348:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239362:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1777580317.239833:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3291:x1863919917482624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44552us (44934us total) trans 8589939048 rc 0/0 00000100:00100000:0.0:1777580317.239843:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12066 00010000:00010000:0.0:1777580317.239882:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239892:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239901:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239909:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.239930:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1777580317.240412:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3291:x1863919917479040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 76713us (93957us total) trans 8589938648 rc 0/0 00000100:00100000:0.0:1777580317.240421:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12062 00010000:00010000:0.0:1777580317.240453:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240464:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240473:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240480:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240490:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1777580317.240776:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3291:x1863919917479552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 75335us (94213us total) trans 8589939049 rc 0/0 00000100:00100000:0.0:1777580317.240815:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12063 00010000:00010000:0.0:1777580317.240841:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1777580317.240850:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240859:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.240871:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240880:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240902:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240909:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009332d534/0xcb2b2f2f7e4cab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240935:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1777580317.240939:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240946:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.240949:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240957:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240965:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240972:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f3b650/0xcb2b2f2f7e4cacc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.240996:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580317.240999:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241006:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.241008:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241015:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241025:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241032:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241044:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580317.241048:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241054:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.241057:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241076:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241087:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241094:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4cada lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241124:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580317.241128:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241165:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.241168:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241175:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241185:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241192:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cabe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241219:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580317.241223:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241231:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.241235:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241243:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241253:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241259:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000610c4bc/0xcb2b2f2f7e4caa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241289:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.241293:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241300:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.241304:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241327:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241338:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241346:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbef6c8f/0xcb2b2f2f7e4cab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.241360:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.241362:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.241364:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.241394:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917483904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.241452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.241497:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1863919917484416:0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.241527:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777580317.241583:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c6a00/2, rc 0, transno 8589938644 00000100:00100000:0.0:1777580317.241590:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917478784:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580317.241602:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c4000/2, rc 0, transno 8589938645 00000100:00100000:0.0:1777580317.241605:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479296:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580317.241619:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384fff100/2, rc 0, transno 8589939043 00000100:00100000:0.0:1777580317.241631:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917479680:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580317.241641:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249c63aa00/2, rc 0, transno 8589939044 00000100:00100000:0.0:1777580317.241653:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c63aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917480192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.241669:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777580317.241676:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3288:1863919917484032:0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.241709:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.241755:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484416 00000100:00100000:0.0:1777580317.241763:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484416 00000100:00100000:0.0:1777580317.241841:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1777580317.241851:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3288:x1863919917484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.241906:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3288:x1863919917484416:12345-0@lo:400:kworker.0 Request processed in 57us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.241913:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1777580317.241943:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484032 00000100:00100000:0.0:1777580317.241947:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484032 00000100:00100000:0.0:1777580317.241978:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1777580317.241987:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3288:x1863919917484032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.242016:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3288:x1863919917484032:12345-0@lo:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.242023:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1777580317.242063:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3288:1863919917484032:0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.242074:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1863919917484416:0@lo:400:kworker.0 00000100:00100000:0.0:1777580317.242383:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2364:x1863919946753024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.242400:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.242410:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.242442:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.242466:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4a476 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e33b expref: 30 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.242484:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.242486:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.242492:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.242504:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.242540:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.242577:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2364:x1863919946753024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 24302us (34365us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.242585:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4427 00010000:00010000:1.0:1777580317.244288:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.244313:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007622e43a/0xcb2b2f2f7e4ca39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.244379:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.244382:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.244385:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.244422:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917484288:0@lo:400:kworker.0 00000100:00100000:1.0:1777580317.244499:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.244582:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a0a80/2, rc 0, transno 8589939048 00000100:00100000:1.0:1777580317.244591:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917482624:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.244607:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a2d80/2, rc 0, transno 8589938646 00000100:00100000:1.0:1777580317.244612:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917483136:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.244623:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023850c5880/2, rc 0, transno 8589938648 00000100:00100000:1.0:1777580317.244627:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917479040:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.244636:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffca80/2, rc 0, transno 8589939049 00000100:00100000:1.0:1777580317.244640:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917479552:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.244649:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d880/2, rc 0, transno 8589939045 00000100:00100000:1.0:1777580317.244652:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917480064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.244667:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580317.244674:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1863919917484160:0@lo:400:kworker.0 00000100:00100000:1.0:1777580317.244700:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.244743:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a2680/2, rc 0, transno 8589939047 00000100:00100000:1.0:1777580317.244748:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917482752:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.244760:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a1c00/2, rc 0, transno 8589939046 00000100:00100000:1.0:1777580317.244763:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917482880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.244809:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484288 00000100:00100000:1.0:1777580317.244817:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484288 00000100:00100000:1.0:1777580317.244874:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484160 00000100:00100000:1.0:1777580317.244877:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484160 00000100:00100000:1.0:1777580317.244899:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1777580317.244909:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917484288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580317.244966:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917484288:12345-0@lo:400:kworker.0 Request processed in 58us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.244974:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1777580317.244992:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1777580317.244997:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1863919917484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580317.245022:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1863919917484160:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.245027:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:3.0:1777580317.245937:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.245959:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4ca4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246000:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.246018:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246043:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246055:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246064:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246090:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.246689:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+16:3290:x1863919917480448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 90051us (102489us total) trans 8589939050 rc 0/0 00000100:00100000:3.0:1777580317.246701:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12061 00000100:00100000:3.0:1777580317.246734:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917483904 00000100:00100000:3.0:1777580317.246744:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917483904 00000100:00100000:3.0:1777580317.246834:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12071 00000100:00100000:3.0:1777580317.246844:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917483904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.246876:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5547 count 1 00010000:00010000:3.0:1777580317.246905:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246931:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 27 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.246940:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.246951:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.246955:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.247003:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 27 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.247020:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 27 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.247037:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917484544:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.247120:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32540 going to sleep for 11 seconds 00000100:00080000:3.0:1777580317.247203:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580317.251999:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.252040:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.258444:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753536 00000100:00100000:0.0:1777580317.258468:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753536 00000100:00100000:0.0:1777580317.258534:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838175164697 time 7838184594454 state 0x0 ref 1 00000100:00100000:0.0:1777580317.258559:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838184694454 time 7838184594454 state 0x1 ref 1 00000100:00100000:0.0:1777580317.258595:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946753792 00000100:00100000:0.0:1777580317.258600:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946753792 00000100:00100000:0.0:1777580317.258644:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838184694454 time 7838184594454 state 0x1 ref 2 00000100:00100000:0.0:1777580317.258678:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838207640137 time 7838207540137 state 0x1 ref 2 00000100:00100000:0.0:1777580317.258699:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283416:x1863919946753536:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.258731:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.258760:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4cb12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec5d expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.258884:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4cb12 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x838:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec5d expref: 78 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.258905:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4cb12 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x838:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec5d expref: 78 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.259651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.260291:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.260303:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260318:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02396b20600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.260324:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260336:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260549:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260558:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10661ba/0xcb2b2f2f7e4caa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260592:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.260595:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.260597:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.260634:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260643:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260649:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260654:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.260659:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260665:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260676:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580317.260679:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.260683:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260697:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4caef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260731:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260738:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260743:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260748:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.260751:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260764:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260773:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024997a0c00) 00010000:00010000:3.0:1777580317.260776:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.260779:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.260795:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4cb04 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.260828:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754048 00000100:00100000:3.0:1777580317.260839:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754048 00000100:00100000:3.0:1777580317.261755:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838207640137 time 7838207540137 state 0x1 ref 3 00000100:00100000:3.0:1777580317.261827:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838210788037 time 7838210688037 state 0x1 ref 3 00000100:00100000:3.0:1777580317.262555:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283415:x1863919946753792:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580317.262665:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.262707:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4caf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec56 expref: 77 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.262737:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa02497a21d00) 00010000:00010000:3.0:1777580317.262754:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.262871:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.262889:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.262903:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.263069:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000992a4ca reply state 00000000866f4c23 transno 8589950964 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.263080:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.263432:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2364:x1863919946750848:12345-192.168.202.9@tcp:2:touch.500 Request processed in 69537us (72660us total) trans 8589938649 rc 0/0 00000100:00100000:1.0:1777580317.263445:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12065 00000100:00100000:1.0:1777580317.263623:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917484800:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.263677:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024997a0c00) 00010000:00010000:0.0:1777580317.263682:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.263686:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b21e00, rc 0) 00000100:00100000:1.0:1777580317.263692:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.263718:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+77:283416:x1863919946753536:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5028us (11733us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.263728:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19796 00000100:00100000:1.0:1777580317.263741:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917485312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.263770:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.263771:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838210788037 time 7838212630693 state 0x0 ref 2 00000100:00100000:0.0:1777580317.263799:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+76:283420:x1863919946754048:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.263813:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.263830:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4cb20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec64 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580317.263835:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae6ac000/2, rc 0, transno 8589939050 00000100:00100000:1.0:1777580317.263846:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917480448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.263860:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580317.263870:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917484928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.263909:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.263942:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484800 00000100:00100000:1.0:1777580317.263949:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484800 00000100:00100000:1.0:1777580317.263986:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485312 00000100:00100000:1.0:1777580317.263989:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485312 00010000:00010000:0.0:1777580317.264006:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.264010:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484928 00000100:00100000:1.0:1777580317.264015:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484928 00000100:00100000:1.0:1777580317.264038:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12072 00000100:00100000:1.0:1777580317.264045:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3290:x1863919917484800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.264064:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5541 count 1 00010000:00010000:0.0:1777580317.264128:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.264162:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.264180:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.264187:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.264194:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.264901:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f2:0x0], index 0: 0 00000100:00100000:3.0:1777580317.265044:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283415:x1863919946753792:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3200us (12999us total) trans 8589950964 rc 0/0 00000100:00100000:3.0:1777580317.265056:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19797 00010000:00010000:0.0:1777580317.265110:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cb35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.265124:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.265159:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.265173:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917484544:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.265201:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.265203:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.265378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.265507:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12073 00000100:00100000:3.0:1777580317.265521:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+18:3290:x1863919917485312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.265550:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5549 count 1 00010000:00010000:3.0:1777580317.265566:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.265585:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.265594:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.265597:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.265600:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.265638:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.265653:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.265669:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917485440:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.265745:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32540 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.266086:0:187653:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:187653:1863919917485568:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777580317.266234:0:187653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777580317.266865:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.266874:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.266883:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.266890:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.266899:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.266921:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.266925:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.266932:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.266940:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4cb27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.266975:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f21ef108 reply state 000000001e5d0186 transno 8589950965 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.266987:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.267068:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4cb20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec64 expref: 79 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.267092:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cb35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec64 expref: 78 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.267113:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:0.0:1777580317.267116:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.267120:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00000100:00100000:0.0:1777580317.267225:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283420:x1863919946754048:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3440us (7577us total) trans 8589950965 rc 0/0 00000100:00100000:0.0:1777580317.267239:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19798 00000100:00100000:0.0:1777580317.267248:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838210788037 time 7838212630693 state 0x2 ref 0 00010000:00010000:1.0:1777580317.267291:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267314:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 28 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267323:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.267326:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.267330:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267497:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 28 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267512:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 28 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.267530:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917485696:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.267616:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c3240 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.267830:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267839:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267849:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267856:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.267876:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580317.268755:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3291:x1863919917483008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 70347us (73749us total) trans 8589938650 rc 0/0 00000100:00100000:1.0:1777580317.268769:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12068 00000100:00100000:3.0:1777580317.269740:0:187653:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.269776:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754176 00000100:00100000:3.0:1777580317.269800:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754176 00010000:00010000:3.0:1777580317.269854:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.269902:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4431 00000100:00100000:3.0:1777580317.269915:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2362:x1863919946754176:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.269934:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.269940:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.269956:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.269984:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990932f2/0xcb2b2f2f7e4ac8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4e6 expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.270002:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.270004:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.270011:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.270022:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.270076:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.270237:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485568 00000100:00100000:1.0:1777580317.270244:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485568 00000100:00100000:1.0:1777580317.270291:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12074 00000100:00100000:1.0:1777580317.270302:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3290:x1863919917484928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.270354:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5542 count 1 00010000:00010000:1.0:1777580317.270502:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.270521:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 28 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.270543:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.270546:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.270550:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.270589:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 28 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.270604:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 28 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.270619:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024acde3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917486848:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.270838:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946754176:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 926us (5460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.270848:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4431 00000100:00100000:1.0:1777580317.270968:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.271013:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917485824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271068:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271117:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271170:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271221:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1863919917484160:0@lo:400:kworker.0 00000100:00100000:1.0:1777580317.271238:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917484288:0@lo:400:kworker.0 00000004:00080000:1.0:1777580317.271255:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a0380/2, rc 0, transno 8589938650 00000100:00100000:1.0:1777580317.271268:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917483008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.271295:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1777580317.271304:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271336:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271372:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024acde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271391:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271491:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917484672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.271517:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271542:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.271562:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271579:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271598:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271616:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ae685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271637:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271660:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777580317.271666:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.271689:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271711:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271738:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271753:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486464:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.271779:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.271846:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485824 00000100:00100000:1.0:1777580317.271854:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485824 00000100:00100000:1.0:1777580317.271892:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486336 00000100:00100000:1.0:1777580317.271895:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486336 00000100:00100000:1.0:1777580317.271913:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486208 00000100:00100000:1.0:1777580317.271916:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486208 00000100:00100000:1.0:1777580317.271934:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486720 00000100:00100000:1.0:1777580317.271937:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486720 00000100:00100000:1.0:1777580317.271969:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917484672 00000100:00100000:1.0:1777580317.271972:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917484672 00000100:00100000:1.0:1777580317.271991:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485184 00000100:00100000:1.0:1777580317.271994:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485184 00000100:00100000:1.0:1777580317.272011:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486080 00000100:00100000:1.0:1777580317.272014:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486080 00000100:00100000:1.0:1777580317.272030:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486592 00000100:00100000:1.0:1777580317.272034:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486592 00000100:00100000:1.0:1777580317.272050:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485056 00000100:00100000:1.0:1777580317.272053:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485056 00000100:00100000:1.0:1777580317.272069:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917485952 00000100:00100000:1.0:1777580317.272072:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917485952 00000100:00100000:1.0:1777580317.272087:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917486464 00000100:00100000:1.0:1777580317.272089:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917486464 00000100:00100000:1.0:1777580317.272110:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12075 00000100:00100000:1.0:1777580317.272121:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:187653:x1863919917485568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777580317.272208:0:205906:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 5634 00000100:00100000:3.0:1777580317.274816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.274862:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.274919:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.274996:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.275015:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.275029:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.275039:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.275061:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777580317.277832:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754688 00000100:00100000:1.0:1777580317.277851:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754688 00000100:00100000:1.0:1777580317.277915:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12076 00000100:00100000:1.0:1777580317.277927:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3291:x1863919917485824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.277968:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5578 count 1 00010000:00010000:1.0:1777580317.277998:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278025:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 28 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278035:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278037:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278057:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278200:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 28 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278216:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 28 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.278235:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393dea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917486976:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.278488:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.278520:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12077 00000100:00100000:1.0:1777580317.278531:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3291:x1863919917486336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.278546:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5585 count 1 00010000:00010000:1.0:1777580317.278562:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278576:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 25 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278584:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278586:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278589:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278614:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 25 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278640:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 25 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.278653:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917487104:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.278681:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.278707:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12078 00000100:00100000:1.0:1777580317.278717:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+24:3291:x1863919917486208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.278732:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5583 count 1 00010000:00010000:1.0:1777580317.278745:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278758:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278766:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278769:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278772:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278803:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 28 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278811:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 28 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.278835:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917487232:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.278856:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.278877:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12079 00000100:00100000:1.0:1777580317.278884:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3291:x1863919917486720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.278897:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5588 count 1 00010000:00010000:1.0:1777580317.278908:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278920:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 25 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278928:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278930:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.278932:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278951:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 25 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.278959:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 25 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.278969:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917487360:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.278990:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02396b0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.279016:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12080 00000100:00100000:1.0:1777580317.279024:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+21:3289:x1863919917484672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.279039:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5543 count 1 00010000:00010000:1.0:1777580317.279056:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279069:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 28 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279076:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279077:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279080:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279218:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 28 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279228:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 28 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.279239:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917487488:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.279263:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738540 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.279310:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580317.279318:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279327:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.279338:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279492:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279514:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279522:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000035375fe/0xcb2b2f2f7e4cac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279548:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.279552:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279558:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.279561:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279568:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279577:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279584:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4cb0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279608:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.279610:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.279612:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.279629:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12081 00000100:00100000:1.0:1777580317.279638:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+21:3289:x1863919917485184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.279652:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5544 count 1 00010000:00010000:1.0:1777580317.279664:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279677:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 28 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279684:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279685:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279688:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279705:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 28 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279714:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 28 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.279724:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917487616:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.279747:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.279771:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12082 00000100:00100000:1.0:1777580317.279779:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917486080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.279806:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5582 count 1 00010000:00010000:1.0:1777580317.279819:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279831:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 28 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279838:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279839:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279841:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279861:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 28 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279870:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 28 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.279880:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917487744:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.279905:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.279925:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12083 00000100:00100000:1.0:1777580317.279934:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917486592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.279948:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5586 count 1 00010000:00010000:1.0:1777580317.279961:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279980:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 25 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.279985:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279987:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.279989:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280010:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 25 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280018:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.280027:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917487872:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.280051:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738300 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.280296:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12084 00000100:00100000:1.0:1777580317.280306:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3289:x1863919917485056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.280319:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5545 count 1 00010000:00010000:1.0:1777580317.280332:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280507:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 28 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280527:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280529:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280532:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280552:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 28 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280563:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 28 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.280574:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917488128:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.280600:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.280621:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12085 00000100:00100000:1.0:1777580317.280630:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917485952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.280644:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5580 count 1 00010000:00010000:1.0:1777580317.280656:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280669:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 28 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280675:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280676:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280686:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280708:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 28 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280718:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 28 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.280729:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917488256:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.280749:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.280772:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12086 00000100:00100000:1.0:1777580317.280781:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917486464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.280809:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5584 count 1 00010000:00010000:1.0:1777580317.280821:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280834:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 25 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280841:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280842:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.280844:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280862:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 25 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.280884:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 25 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.280894:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917488384:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.280917:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738000 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.280938:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12087 00000100:00100000:1.0:1777580317.280947:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946754688:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580317.281620:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946754688:12345-192.168.202.9@tcp:2:touch.500 Request processed in 669us (6696us total) trans 8589939051 rc 0/0 00000100:00100000:1.0:1777580317.281630:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12087 00000100:00100000:1.0:1777580317.281773:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754560 00000100:00100000:1.0:1777580317.281794:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754560 00000100:00100000:1.0:1777580317.281831:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838210788037 time 7838212630693 state 0x0 ref 1 00000100:00100000:1.0:1777580317.281846:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838212730693 time 7838212630693 state 0x1 ref 1 00000100:00100000:1.0:1777580317.281878:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838212730693 time 7838230740055 state 0x0 ref 1 00000100:00100000:1.0:1777580317.281890:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283415:x1863919946754560:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.281908:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.281932:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4cba5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec6b expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.281996:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x839:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec6b expref: 80 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282027:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4cba5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x839:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec6b expref: 80 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282053:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580317.282056:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.282060:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee8000, rc 0) 00000100:00100000:1.0:1777580317.282078:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283415:x1863919946754560:12345-192.168.202.9@tcp:101:touch.500 Request processed in 191us (7216us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.282086:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19799 00000100:00100000:1.0:1777580317.282090:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838212730693 time 7838230740055 state 0x2 ref 0 00000100:00100000:1.0:1777580317.282256:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580317.282272:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917488000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.282332:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.282386:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917488000 00000100:00100000:1.0:1777580317.282391:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917488000 00000100:00100000:1.0:1777580317.282586:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12088 00000100:00100000:1.0:1777580317.282595:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3290:x1863919917488000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.282614:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5548 count 1 00010000:00010000:1.0:1777580317.282636:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282655:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 26 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282663:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.282674:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.282678:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282710:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 26 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.282723:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 26 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.282736:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917488512:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.282997:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.285812:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:3288:x1863919917483904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38959us (44348us total) trans 8589938651 rc 0/0 00000100:00100000:3.0:1777580317.285828:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12071 00000004:00080000:1.0:1777580317.285837:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a1880/2, rc 0, transno 8589938651 00000100:00100000:1.0:1777580317.285853:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917483904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1777580317.285882:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.285948:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917488640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.285998:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.286047:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917488640 00000100:00100000:1.0:1777580317.286054:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917488640 00000100:00100000:1.0:1777580317.286253:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12089 00000100:00100000:1.0:1777580317.286267:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+23:3288:x1863919917488640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.286302:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5550 count 1 00010000:00010000:1.0:1777580317.286333:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.286360:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 26 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.286386:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.286388:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.286393:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.286600:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 26 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.286615:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 26 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.286629:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917488768:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.286698:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023917c3000 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.289385:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.289398:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.289405:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.289412:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.289423:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.289449:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024997a0200) 00010000:00010000:3.0:1777580317.289452:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.289458:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.289464:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4cb19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.289538:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754432 00000100:00100000:3.0:1777580317.294814:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754432 00000100:00100000:3.0:1777580317.294918:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4238 00000100:00100000:3.0:1777580317.294931:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+79:283414:x1863919946754432:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580317.298755:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:187653:x1863919917485568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26623us (32508us total) trans 8589939052 rc 0/0 00000100:00100000:1.0:1777580317.298773:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12075 00000100:00100000:1.0:1777580317.298877:0:187653:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:187653:1863919917485568:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777580317.298899:0:187653:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x15f2:0x0]-[0x240000400:0x1621:0x0] 00000100:00100000:3.0:1777580317.300103:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283414:x1863919946754432:12345-192.168.202.9@tcp:35:touch.500 Request processed in 5166us (25288us total) trans 8589950966 rc 0/0 00000100:00100000:3.0:1777580317.300118:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4238 00010000:00010000:3.0:1777580317.300229:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.301586:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301607:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301617:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301624:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.301630:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301639:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301682:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02486090600) 00010000:00010000:2.0:1777580317.301685:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.301692:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.301701:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4cb2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.302306:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.302311:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.302313:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.302380:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.302413:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.302445:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.302455:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755200 00000100:00100000:2.0:1777580317.302468:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755200 00000100:00100000:3.0:1777580317.302473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.302507:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580317.302523:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 29 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.302560:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755072 00000100:00100000:2.0:1777580317.302575:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755072 00010000:00010000:2.0:1777580317.302593:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 30 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.302620:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755328 00000100:00100000:2.0:1777580317.302623:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755328 00010000:00010000:2.0:1777580317.302640:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302651:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.302665:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4432 00000100:00100000:2.0:1777580317.302678:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946755200:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777580317.302704:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917485440:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.302708:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.302718:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.302732:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 30 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302734:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.302771:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1777580317.302776:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4433 00010000:00010000:2.0:1777580317.302776:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.302792:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.302802:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946755072:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.302807:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302811:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.302821:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 30 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302834:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 30 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.302834:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.302852:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.302854:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.302858:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302867:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.302887:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946755200:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 211us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.302900:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4432 00010000:00010000:3.0:1777580317.302906:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.302933:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946755072:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 147us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.302942:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4433 00000100:00100000:3.0:1777580317.302964:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4434 00000100:00100000:3.0:1777580317.302972:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2361:x1863919946755328:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.302982:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.302987:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.302999:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.303014:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f407177f/0xcb2b2f2f7e4ae1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e54f expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.303027:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.303029:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.303031:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.303038:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.303057:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.306124:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2361:x1863919946755328:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 163us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.310995:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4434 00010000:00010000:3.0:1777580317.311077:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.311097:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.311112:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.311121:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.314160:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000400fd74b/0xcb2b2f2f7e4a7da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e453 expref: 28 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.314193:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917485696:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.314229:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.314265:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.314272:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.314283:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.314292:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.314548:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946754944 00000100:00100000:0.0:1777580317.314559:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946754944 00000100:00100000:0.0:1777580317.314610:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838212730693 time 7838230740055 state 0x0 ref 1 00000100:00100000:2.0:1777580317.314611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.314628:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838230840055 time 7838230740055 state 0x1 ref 1 00000100:00100000:2.0:1777580317.314643:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.314655:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755584 00000100:00100000:0.0:1777580317.314659:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755584 00000100:00100000:2.0:1777580317.314670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.314677:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838230840055 time 7838230740055 state 0x1 ref 2 00000100:00100000:0.0:1777580317.314703:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838263665665 time 7838263565665 state 0x1 ref 2 00000100:00100000:0.0:1777580317.314720:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283420:x1863919946754944:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:2.0:1777580317.314779:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.314815:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.314820:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777580317.314833:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.314849:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.314856:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cb35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec64 expref: 80 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.314883:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa02498f4a400) 00000100:00100000:2.0:1777580317.314900:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.314908:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.314930:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.314971:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.315000:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755712 00000100:00100000:2.0:1777580317.315004:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755712 00010000:00010000:0.0:1777580317.315010:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.315027:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315032:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 26 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.315042:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315056:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755968 00000100:00100000:2.0:1777580317.315059:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755968 00010000:00010000:2.0:1777580317.315074:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 29 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315104:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946755840 00000100:00100000:2.0:1777580317.315107:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946755840 00010000:00010000:2.0:1777580317.315125:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 28 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315165:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756096 00000100:00100000:2.0:1777580317.315168:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756096 00010000:00010000:2.0:1777580317.315183:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 30 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315194:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756352 00000100:00100000:2.0:1777580317.315196:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756352 00010000:00010000:2.0:1777580317.315208:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 27 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315218:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756224 00000100:00100000:2.0:1777580317.315220:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756224 00010000:00010000:2.0:1777580317.315240:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 28 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315252:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756480 00000100:00100000:2.0:1777580317.315255:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756480 00010000:00010000:2.0:1777580317.315267:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 29 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315277:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756608 00000100:00100000:2.0:1777580317.315279:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756608 00010000:00010000:2.0:1777580317.315290:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 30 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315300:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756736 00000100:00100000:2.0:1777580317.315303:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756736 00010000:00010000:2.0:1777580317.315315:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 31 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.315329:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4435 00000100:00100000:2.0:1777580317.315337:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946755712:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.315348:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.315353:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 28 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315365:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 28 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315396:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315398:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315403:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315414:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315434:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.315496:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+28:2361:x1863919946755712:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 159us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.315505:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4435 00000100:00100000:2.0:1777580317.315528:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4436 00000100:00100000:2.0:1777580317.315535:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946755968:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.315543:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.315548:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 31 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315558:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 31 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315572:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315574:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315577:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315598:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315611:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.315631:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2361:x1863919946755968:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 96us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.315638:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4436 00000100:00100000:2.0:1777580317.315652:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4437 00000100:00100000:2.0:1777580317.315659:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946755840:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.315667:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.315671:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 30 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315681:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 30 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315694:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315696:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315699:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315706:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315718:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.315743:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946755840:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 85us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.315751:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4437 00000100:00100000:2.0:1777580317.315766:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4438 00000100:00100000:2.0:1777580317.315772:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946756096:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.315779:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.315798:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 30 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315812:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 30 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315824:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315825:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315828:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315836:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315848:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.315865:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2362:x1863919946756096:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 94us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.315871:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4438 00000100:00100000:2.0:1777580317.315884:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4439 00000100:00100000:2.0:1777580317.315891:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946756352:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.315908:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.315913:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 27 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315924:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 27 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315939:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315941:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.315944:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315952:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.315965:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.315984:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2362:x1863919946756352:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 94us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.315991:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4439 00000100:00100000:2.0:1777580317.316036:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4440 00000100:00100000:2.0:1777580317.316043:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946756224:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.316052:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.316057:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 26 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316067:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 26 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316087:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316089:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316093:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316101:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316117:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.316168:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946756224:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 125us (1335us total) trans 0 rc 0/0 00000004:00010000:0.0:1777580317.316168:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e2519a8a reply state 00000000711c127e transno 8589950967 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.316185:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4440 00000100:00100000:0.0:1777580317.316186:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580317.316202:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4441 00000100:00100000:2.0:1777580317.316210:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946756480:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.316219:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.316224:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 29 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316235:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 29 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316247:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316249:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316252:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316272:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316286:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.316306:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946756480:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 97us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.316312:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4441 00000100:00100000:2.0:1777580317.316326:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4442 00000100:00100000:2.0:1777580317.316333:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946756608:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.316341:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.316345:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 28 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316354:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 28 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316366:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316367:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316370:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316377:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316387:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.316412:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946756608:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 79us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.316418:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4442 00000100:00100000:2.0:1777580317.316433:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4443 00000100:00100000:2.0:1777580317.316439:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946756736:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.316448:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.316453:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316463:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 29 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316475:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316477:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.316480:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316488:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.316499:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.316511:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946756736:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 72us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.316517:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4443 00000100:00100000:0.0:1777580317.317040:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+81:283420:x1863919946754944:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2322us (14665us total) trans 8589950967 rc 0/0 00000100:00100000:0.0:1777580317.317051:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19800 00000100:00100000:0.0:1777580317.317083:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838263665665 time 7838265944193 state 0x0 ref 1 00000100:00100000:0.0:1777580317.317098:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+80:283423:x1863919946755584:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.317116:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.317169:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cbc1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec72 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317339:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317356:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317367:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317399:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317407:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.317413:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.318335:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15ce:0x0], index 1: 0 00010000:00010000:0.0:1777580317.318583:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4cbd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318598:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318609:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318656:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318666:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318674:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318681:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.318687:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.318697:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777580317.318706:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580317.318715:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318732:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.318736:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.318742:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318748:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cbc8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.318768:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000023eb01b7 reply state 0000000035384adb transno 8589950968 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.318778:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.318836:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cbc1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec72 expref: 83 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318857:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4cbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec72 expref: 82 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.318867:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f800) 00000100:00100000:2.0:1777580317.318868:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.318872:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.318875:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b638e400, rc 0) 00000100:00100000:2.0:1777580317.318899:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.318938:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.318953:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+83:283423:x1863919946755584:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1855us (16443us total) trans 8589950968 rc 0/0 00000100:00100000:0.0:1777580317.318964:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19801 00000100:00100000:0.0:1777580317.318973:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838263665665 time 7838265944193 state 0x2 ref 0 00000100:00100000:2.0:1777580317.319009:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.319036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.319037:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757632 00000100:00100000:0.0:1777580317.319048:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757632 00000100:00100000:2.0:1777580317.319066:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757376 00000100:00100000:2.0:1777580317.319071:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757376 00010000:00010000:0.0:1777580317.319086:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 29 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.319110:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757248 00000100:00100000:0.0:1777580317.319113:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757248 00010000:00010000:0.0:1777580317.319158:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 26 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.319173:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757504 00000100:00100000:0.0:1777580317.319176:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757504 00010000:00010000:0.0:1777580317.319193:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 27 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.319209:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4444 00000100:00100000:0.0:1777580317.319220:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946757632:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.319235:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.319240:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 29 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319254:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 29 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.319264:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+24:3290:x1863919917485312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53746us (55493us total) trans 8589938652 rc 0/0 00000100:00100000:3.0:1777580317.319275:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12073 00010000:00010000:0.0:1777580317.319278:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319281:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319294:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319306:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319330:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.319356:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946757632:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 139us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.319363:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4444 00000100:00100000:0.0:1777580317.319377:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4445 00000100:00100000:0.0:1777580317.319384:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946757248:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.319391:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.319396:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 26 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319406:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 26 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319420:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319421:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319425:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319432:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319459:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.319483:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946757248:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 99us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.319490:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4445 00010000:00010000:2.0:1777580317.319498:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 27 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.319506:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4446 00000100:00100000:0.0:1777580317.319514:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2363:x1863919946757504:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.319523:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.319528:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 27 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319540:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 27 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319555:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319557:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.319561:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319569:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.319582:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.319600:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2363:x1863919946757504:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 87us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.319607:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4446 00000100:00100000:2.0:1777580317.319689:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4447 00000100:00100000:2.0:1777580317.319699:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946757376:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.319708:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.319714:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 26 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.319725:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 26 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.319738:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+25:3290:x1863919917484800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55690us (56045us total) trans 8589938653 rc 0/0 00010000:00010000:2.0:1777580317.319741:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.319745:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.319749:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.319751:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12072 00000100:00100000:1.0:1777580317.319770:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946756864 00000100:00100000:1.0:1777580317.319776:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946756864 00000100:00100000:1.0:1777580317.319817:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12090 00000100:00100000:1.0:1777580317.319824:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946756864:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:2.0:1777580317.319848:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.319867:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.319891:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946757376:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 194us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.319909:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4447 00000100:00100000:1.0:1777580317.320082:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946756864:12345-192.168.202.9@tcp:2:touch.500 Request processed in 258us (5110us total) trans 8589938654 rc 0/0 00000100:00100000:1.0:1777580317.320089:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12090 00010000:00010000:1.0:1777580317.320277:0:205905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db7ee0ed/0xcb2b2f2f7e4a827 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e468 expref: 28 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.320301:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024acde3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:205905:1863919917486848:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.320327:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.320340:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.320347:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.320357:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.320366:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.320392:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777580317.320413:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777580317.320421:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320430:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.320434:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320442:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320455:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320462:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4cb43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320485:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580317.320489:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320496:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc157f320) 00000100:00100000:3.0:1777580317.320503:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757120 00000100:00100000:3.0:1777580317.320509:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757120 00010000:00010000:2.0:1777580317.320510:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320530:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320542:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.320547:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4239 00010000:00010000:2.0:1777580317.320550:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4cb4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.320555:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+83:283416:x1863919946757120:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:2.0:1777580317.320575:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.320579:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320585:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.320587:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320594:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320603:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320609:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4cb51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.320632:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.320634:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.320636:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.320864:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+84:283416:x1863919946757120:12345-192.168.202.9@tcp:35:touch.500 Request processed in 308us (1825us total) trans 8589950969 rc 0/0 00000100:00100000:3.0:1777580317.320873:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4239 00000100:00100000:1.0:1777580317.320977:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3290:x1863919917484928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50678us (57066us total) trans 8589938655 rc 0/0 00000100:00100000:1.0:1777580317.320985:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12074 00010000:00010000:1.0:1777580317.321013:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.321046:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096c5082/0xcb2b2f2f7e4b196 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f7 expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.322131:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012283b49/0xcb2b2f2f7e4a7e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e45a expref: 27 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.322174:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917487488:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.322204:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.322227:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.322234:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.322245:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.322254:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580317.322267:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239235d180/2, rc 0, transno 8589938655 00010000:00010000:0.0:1777580317.322280:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.322289:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239235d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917484928:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580317.322302:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a0e00/2, rc 0, transno 8589938653 00000100:00100000:2.0:1777580317.322307:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917484800:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580317.322318:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095c380/2, rc 0, transno 8589938652 00000100:00100000:2.0:1777580317.322322:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917485312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580317.322356:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4acc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e502 expref: 28 pid: 205897 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.322379:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917487232:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.322394:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.322404:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.322411:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.322418:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.322440:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.322454:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777580317.322459:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580317.322466:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322473:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.322478:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322486:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322505:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322512:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7dff672/0xcb2b2f2f7e4cb74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322533:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.322536:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322543:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.322545:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322552:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322578:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322585:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4cb66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.322602:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.322604:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.322606:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.322978:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917486208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44261us (51639us total) trans 8589939053 rc 0/0 00000100:00100000:2.0:1777580317.322989:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12078 00010000:00010000:2.0:1777580317.323058:0:205908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb17b5f2/0xcb2b2f2f7e4b18f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5f0 expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.323075:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917488768:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.323082:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+24:3289:x1863919917484672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44055us (51559us total) trans 8589938656 rc 0/0 00000100:00100000:0.0:1777580317.323092:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12080 00010000:00010000:0.0:1777580317.323176:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4b19d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e5fe expref: 25 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.323212:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917487360:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.323230:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323241:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323247:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323256:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323262:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323276:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.323430:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917486720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44546us (52037us total) trans 8589939054 rc 0/0 00000100:00100000:0.0:1777580317.323437:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12079 00010000:00010000:0.0:1777580317.323476:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4ae32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e55d expref: 24 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.323487:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917487104:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.323508:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323517:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323524:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.323532:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.323682:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917487872:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.323701:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.323710:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.323716:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.323716:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.323738:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.323740:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.323759:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.323761:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.323782:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.323801:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.323803:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580317.323821:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1777580317.324012:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3289:x1863919917486592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44077us (52371us total) trans 8589939055 rc 0/0 00000100:00100000:1.0:1777580317.324020:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12083 00000100:00100000:1.0:1777580317.324290:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.324335:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.324381:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095ed80/2, rc 0, transno 8589939053 00000100:00100000:1.0:1777580317.324392:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486208:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.324506:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024acde0000/2, rc 0, transno 8589939054 00000100:00100000:1.0:1777580317.324511:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024acde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.324524:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580317.324530:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.324553:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.324660:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917488896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.324686:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.324721:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023863a1500/2, rc 0, transno 8589938656 00000100:00100000:1.0:1777580317.324732:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917484672:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580317.324747:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae685c00/2, rc 0, transno 8589939055 00000100:00100000:1.0:1777580317.324750:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580317.324774:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580317.324782:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324804:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.324810:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324819:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324843:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324866:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cb6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.324869:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3288:x1863919917488640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38604us (38869us total) trans 8589938657 rc 0/0 00000100:00100000:2.0:1777580317.324886:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12089 00010000:00010000:1.0:1777580317.324902:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580317.324908:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.324915:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917489152 00010000:00010000:1.0:1777580317.324915:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.324921:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.324924:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917489152 00010000:00010000:1.0:1777580317.324931:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324942:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324949:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cb89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.324965:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917489024 00010000:00010000:1.0:1777580317.324968:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1777580317.324969:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917489024 00010000:00010000:1.0:1777580317.324973:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.324981:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc157f320) 00000100:00100000:2.0:1777580317.324988:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917488896 00000100:00100000:2.0:1777580317.324992:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917488896 00010000:00010000:1.0:1777580317.324993:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.325003:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.325010:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.325013:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12091 00010000:00010000:1.0:1777580317.325016:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.325022:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917489152:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580317.325033:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cbb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.325049:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.325051:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.325053:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1777580317.325062:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5554 count 1 00010000:00010000:2.0:1777580317.325101:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325121:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 24 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325129:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.325132:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.325154:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.325185:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12092 00010000:00010000:2.0:1777580317.325188:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 24 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.325193:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917489024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.325207:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5552 count 1 00010000:00010000:2.0:1777580317.325217:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 24 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.325232:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238639f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917489280:192.168.202.9@tcp:104: 00000004:00080000:1.0:1777580317.325247:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc42a00/2, rc 0, transno 8589938657 00000100:00100000:1.0:1777580317.325254:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917488640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.325286:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12093 00000100:00100000:1.0:1777580317.325296:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3289:x1863919917488896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.325310:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5551 count 1 00000100:00100000:2.0:1777580317.325316:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15900 going to sleep for 11 seconds 00010000:00010000:2.0:1777580317.325352:0:205896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010f55ea4/0xcb2b2f2f7e4ae24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e548 expref: 24 pid: 205896 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.325365:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917488512:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.325385:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325396:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325403:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325412:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325420:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.325453:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580317.326611:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326649:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 23 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326659:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.326662:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.326665:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326717:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 23 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326753:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 23 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.326774:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917489408:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.326872:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4c300 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.326903:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.326911:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326920:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.326924:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326933:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326956:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326964:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd1b659/0xcb2b2f2f7e4cbac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.326998:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.327000:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.327009:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.327761:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.327826:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 23 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.327837:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.327850:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.327853:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.327893:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 23 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.327908:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 23 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.327923:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917489536:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.327985:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32540 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.328983:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329023:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.329429:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917486336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50897us (58254us total) trans 8589939056 rc 0/0 00000100:00100000:0.0:1777580317.329439:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12077 00010000:00010000:0.0:1777580317.329524:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9e901f/0xcb2b2f2f7e4a7be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e437 expref: 27 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.329540:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393dea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917486976:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.329567:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329595:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329602:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329612:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329620:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329642:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580317.329816:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917485824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51891us (58748us total) trans 8589939057 rc 0/0 00000100:00100000:0.0:1777580317.329823:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12076 00010000:00010000:0.0:1777580317.329877:0:206018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4a8a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e476 expref: 26 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.329888:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917488256:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.329902:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329910:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329925:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329935:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.329943:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.329951:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3290:x1863919917488000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47355us (47616us total) trans 8589938658 rc 0/0 00010000:00010000:0.0:1777580317.329955:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580317.329965:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12088 00010000:00010000:2.0:1777580317.330012:0:188248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4ae55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e556 expref: 22 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.330027:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917488384:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.330044:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330055:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330063:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330071:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330079:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330102:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1777580317.330109:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:3289:x1863919917485952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49478us (58370us total) trans 8589939058 rc 0/0 00000100:00100000:0.0:1777580317.330119:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12085 00010000:00010000:0.0:1777580317.330199:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b7be89/0xcb2b2f2f7e4a7d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e44c expref: 26 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.330216:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc41500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:188246:1863919917488128:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.330230:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.330238:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.330245:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.330261:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.330268:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.330279:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1777580317.330285:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3289:x1863919917486464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49505us (58504us total) trans 8589939059 rc 0/0 00000100:00100000:2.0:1777580317.330291:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12086 00010000:00010000:2.0:1777580317.330315:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777580317.330322:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330331:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.330335:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330344:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330380:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330388:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4cb5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330411:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777580317.330415:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330422:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.330425:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330447:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330459:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330467:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002173d60/0xcb2b2f2f7e4cb58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330484:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777580317.330488:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330495:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.330498:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330518:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330527:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330535:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090417f6d/0xcb2b2f2f7e4cb97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.330560:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580317.331192:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331201:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.331204:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331212:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331225:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331232:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4cb9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331249:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.331251:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331257:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.331259:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331279:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331290:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331296:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef596cd6/0xcb2b2f2f7e4cb90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331312:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.331314:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.331316:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.331383:0:188247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b2fc935/0xcb2b2f2f7e4ac87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e4df expref: 25 pid: 205906 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.331395:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917487744:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.331415:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331425:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331431:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331454:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331463:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.331484:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.331939:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3289:x1863919917486080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52158us (60337us total) trans 8589939060 rc 0/0 00000100:00100000:2.0:1777580317.331950:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12082 00010000:00010000:2.0:1777580317.332004:0:207637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000434cbc6/0xcb2b2f2f7e4a89e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e46f expref: 25 pid: 189456 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.332017:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917487616:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.332031:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.332040:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.332047:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.332055:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.332073:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.332082:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777580317.333607:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580317.333626:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333644:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.333650:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333662:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333694:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333702:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b0e47ec/0xcb2b2f2f7e4cb82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333738:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.333744:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333752:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.333756:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333763:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333810:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333817:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda54a41/0xcb2b2f2f7e4cb7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.333834:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.333836:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.333839:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.333967:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.333993:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917490048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.334080:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.334204:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095fb80/2, rc 0, transno 8589939057 00000100:00100000:1.0:1777580317.334217:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917485824:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.334231:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ae4b5c00/2, rc 0, transno 8589939056 00000100:00100000:1.0:1777580317.334236:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ae4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917486336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.334255:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580317.334262:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.334292:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777580317.334339:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc40380/2, rc 0, transno 8589938658 00000100:00100000:1.0:1777580317.334352:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917488000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580317.334361:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490048 00000100:00100000:3.0:1777580317.334371:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490048 00000100:00100000:1.0:1777580317.334374:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917489792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580317.334421:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917489920 00000100:00100000:3.0:1777580317.334425:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917489920 00000100:00100000:3.0:1777580317.334458:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12094 00000100:00100000:3.0:1777580317.334468:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3291:x1863919917490048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.334504:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5555 count 1 00010000:00010000:3.0:1777580317.334535:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.334557:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.334565:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.334567:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.334571:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.334616:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.334631:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.334645:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917490304:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.334715:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248168b540 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.334729:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.334743:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12095 00000100:00100000:3.0:1777580317.334750:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+25:3291:x1863919917489920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580317.334766:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5591 count 1 00000100:00100000:1.0:1777580317.335089:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777580317.335099:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.335117:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 21 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.335125:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.335126:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.335129:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.335175:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 21 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.335201:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 21 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.335212:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917490432:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.335244:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248a0c9540 going to sleep for 11 seconds 00000004:00080000:1.0:1777580317.335918:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f100/2, rc 0, transno 8589939058 00000100:00100000:1.0:1777580317.335927:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485952:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.335940:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55c2300/2, rc 0, transno 8589939059 00000100:00100000:1.0:1777580317.335944:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486464:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.335954:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f800/2, rc 0, transno 8589939060 00000100:00100000:1.0:1777580317.335958:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917486080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.335973:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777580317.335982:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917489664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.336018:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.336052:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249dc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.336072:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.336340:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917489792 00000100:00100000:1.0:1777580317.336347:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917489792 00000100:00100000:1.0:1777580317.336394:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917489664 00000100:00100000:1.0:1777580317.336397:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917489664 00000100:00100000:1.0:1777580317.336420:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490176 00000100:00100000:1.0:1777580317.336422:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490176 00000100:00100000:1.0:1777580317.336450:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12096 00000100:00100000:1.0:1777580317.336461:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3289:x1863919917489792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.336488:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5590 count 1 00010000:00010000:1.0:1777580317.336515:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.336539:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 21 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.336580:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.336583:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.336587:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.336600:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3289:x1863919917485056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56294us (64908us total) trans 8589938659 rc 0/0 00000100:00100000:0.0:1777580317.336610:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12084 00010000:00010000:1.0:1777580317.336620:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 21 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.336635:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 21 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.336639:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12097 00000100:00100000:0.0:1777580317.336651:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3289:x1863919917489664:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.336656:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917491328:192.168.202.9@tcp:104: 00002000:00080000:0.0:1777580317.336669:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5587 count 1 00010000:00010000:0.0:1777580317.336684:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.336699:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 21 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.336706:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.336708:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.336711:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.336717:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32c00 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.336734:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 21 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.336738:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239e024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490560:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580317.336755:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 21 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.336769:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917491456:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.336773:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.336818:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290600 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.336896:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490560 00000100:00100000:3.0:1777580317.336903:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490560 00000100:00100000:3.0:1777580317.336939:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12098 00000100:00100000:3.0:1777580317.336946:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3289:x1863919917490176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.336960:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5553 count 1 00010000:00010000:3.0:1777580317.337006:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.337020:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 23 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.337029:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.337031:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.337034:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.337038:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917491072:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1777580317.337063:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 23 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.337075:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.337076:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580317.337097:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917491584:192.168.202.9@tcp:104: 00000004:00080000:1.0:1777580317.337124:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02397d5df80/2, rc 0, transno 8589938659 00000100:00100000:1.0:1777580317.337160:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.337172:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777580317.337178:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.337615:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917491072 00000100:00100000:0.0:1777580317.337621:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917491072 00000100:00100000:0.0:1777580317.337648:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12099 00000100:00100000:0.0:1777580317.337656:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3289:x1863919917490560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.337671:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5592 count 1 00010000:00010000:0.0:1777580317.337686:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.337702:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 21 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.337709:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.337710:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.337713:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.337737:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 21 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.337748:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 21 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.337771:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917491712:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.338155:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae2426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.338258:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.338306:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239e024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917490688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580317.338354:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+29:3289:x1863919917485184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58715us (66788us total) trans 8589938660 rc 0/0 00000100:00100000:1.0:1777580317.338355:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.338372:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917491200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.338396:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.338425:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580317.338433:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917490816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.338454:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580317.338459:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12081 00000100:00100000:1.0:1777580317.338494:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490944 00000100:00100000:1.0:1777580317.338499:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490944 00000100:00100000:1.0:1777580317.338527:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490688 00000100:00100000:1.0:1777580317.338530:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490688 00000100:00100000:1.0:1777580317.338545:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917491200 00000100:00100000:1.0:1777580317.338549:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917491200 00000100:00100000:2.0:1777580317.338701:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917490816 00000100:00100000:2.0:1777580317.338706:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917490816 00000100:00100000:2.0:1777580317.338726:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12100 00000100:00100000:2.0:1777580317.338734:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+32:3289:x1863919917491072:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.338849:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12101 00000100:00100000:1.0:1777580317.338857:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3289:x1863919917490944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580317.338872:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5600 count 1 00002000:00080000:1.0:1777580317.338873:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5594 count 1 00010000:00010000:2.0:1777580317.338898:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.338899:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.338934:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 21 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.338934:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 24 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.338956:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.338957:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.338961:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.338961:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.338966:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.338966:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339014:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 24 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.339015:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 21 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339072:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 24 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.339073:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 21 pid: 206352 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.339102:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238639c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917491968:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.339164:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15000 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.339231:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1671500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917491840:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.339257:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.339281:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12102 00000100:00100000:1.0:1777580317.339293:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3290:x1863919917490688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.339309:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5589 count 1 00010000:00010000:1.0:1777580317.339324:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339338:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 21 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339345:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.339347:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.339351:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339374:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 21 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339384:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 21 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.339421:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1671f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917492096:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.339440:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32900 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.339459:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12103 00000100:00100000:1.0:1777580317.339467:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3290:x1863919917490816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.339480:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5593 count 1 00010000:00010000:1.0:1777580317.339494:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339506:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 24 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339512:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.339514:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.339516:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339535:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 24 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339545:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 24 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.339649:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917492224:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.339663:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.339675:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.339706:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12104 00000100:00100000:1.0:1777580317.339718:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+29:3290:x1863919917491200:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1777580317.339728:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.339728:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00002000:00080000:1.0:1777580317.339738:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5557 count 1 00010000:00010000:3.0:1777580317.339739:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339750:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339757:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.339758:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339763:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339792:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339799:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 24 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339808:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.339810:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.339812:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa02497a21600) 00010000:00010000:1.0:1777580317.339814:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339818:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.339825:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.339833:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cbba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339845:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 24 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.339857:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 24 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.339868:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917492352:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.339880:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758016 00000100:00100000:3.0:1777580317.339887:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758016 00000100:00100000:1.0:1777580317.339890:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.339929:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4240 00000100:00100000:3.0:1777580317.339948:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+83:283415:x1863919946758016:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.339996:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:1.0:1777580317.340004:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ac337100/2, rc 0, transno 8589938660 00000100:00100000:1.0:1777580317.340020:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917485184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.340043:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946757760 00000100:00100000:1.0:1777580317.340048:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946757760 00000100:00100000:1.0:1777580317.340085:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838263665665 time 7838265944193 state 0x0 ref 1 00000100:00100000:1.0:1777580317.340318:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838266044193 time 7838265944193 state 0x1 ref 1 00000100:00100000:1.0:1777580317.340338:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758272 00000100:00100000:1.0:1777580317.340342:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758272 00000100:00100000:1.0:1777580317.340358:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838072419327 time 7838073256841 state 0x0 ref 1 00000100:00100000:1.0:1777580317.340364:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838073356841 time 7838073256841 state 0x1 ref 1 00000100:00100000:1.0:1777580317.340387:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838073356841 time 7838289248216 state 0x0 ref 1 00000100:00100000:1.0:1777580317.340461:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283403:x1863919946758272:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580317.340505:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580317.340525:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4c848 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba0 expref: 86 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.340544:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4c768 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb61 expref: 85 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.340663:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.340883:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa0249f048b00) 00010000:00010000:1.0:1777580317.340899:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.340929:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.340945:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.340958:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.340994:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.341002:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.341009:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.341181:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290180 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.341376:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.341386:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.341394:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.341832:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758528 00000100:00100000:0.0:1777580317.341840:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758528 00000100:00100000:0.0:1777580317.341881:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838266044193 time 7838265944193 state 0x1 ref 2 00000100:00100000:0.0:1777580317.341916:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838290879295 time 7838290779295 state 0x1 ref 2 00000100:00100000:0.0:1777580317.341935:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283420:x1863919946757760:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.341955:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.341975:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4cc5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec79 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342028:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4cc5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec79 expref: 86 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342043:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4cc5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec79 expref: 86 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342064:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa0249f66ff00) 00010000:00010000:0.0:1777580317.342068:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.342071:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4d400, rc 0) 00000100:00100000:0.0:1777580317.342121:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283420:x1863919946757760:12345-192.168.202.9@tcp:101:touch.500 Request processed in 193us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.342129:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19802 00000100:00100000:0.0:1777580317.342187:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838290879295 time 7838291049215 state 0x0 ref 1 00000100:00100000:0.0:1777580317.342196:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283423:x1863919946758528:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580317.342351:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.342370:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4cbd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec72 expref: 85 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342388:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f800) 00010000:00010000:0.0:1777580317.342398:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.342464:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342474:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.342482:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.342606:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000ff476f2 reply state 0000000012e1f6d9 transno 8589950971 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.342615:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000040:00080000:1.0:1777580317.342625:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1894, 64 off129408 00000004:00080000:1.0:1777580317.342639:0:187630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7838291503348ns, next at 7839291500543ns, rc = 0 00000100:00100000:0.0:1777580317.342687:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+87:283423:x1863919946758528:12345-192.168.202.9@tcp:36:touch.500 Request processed in 490us (2022us total) trans 8589950971 rc 0/0 00000100:00100000:0.0:1777580317.342694:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19804 00010000:00010000:1.0:1777580317.342699:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.342699:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838290879295 time 7838291049215 state 0x2 ref 0 00010000:00010000:1.0:1777580317.342715:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.342724:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.342731:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.342751:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.342757:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.342780:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.343794:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283415:x1863919946758016:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3826us (4045us total) trans 8589950970 rc 0/0 00000100:00100000:3.0:1777580317.343809:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4240 00010000:00010000:1.0:1777580317.344579:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344594:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344601:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344607:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.344612:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344622:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344639:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa02487fb4100) 00010000:00010000:1.0:1777580317.344642:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580317.344646:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344652:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4cc54 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344715:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344721:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344727:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344732:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.344735:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344741:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344750:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.344752:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.344755:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.344761:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4cc46 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.344774:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000da36f456 reply state 00000000a734d7d1 transno 8589950972 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.344793:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.344873:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+86:283403:x1863919946758272:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4474us (4873us total) trans 8589950972 rc 0/0 00000100:00100000:1.0:1777580317.344883:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19803 00000100:00100000:1.0:1777580317.344896:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838073356841 time 7838289248216 state 0x2 ref 0 00000100:00100000:1.0:1777580317.344968:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917492480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.349796:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777580317.349884:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.349898:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.349913:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.349919:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.349930:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.349953:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82d:0x0].0x0 (ffffa02487fb4100) 00010000:00010000:3.0:1777580317.349956:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580317.349962:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.349969:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4cc69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.349997:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.350000:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.350003:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.350052:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249f2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917492608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.350332:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.350385:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917492480 00000100:00100000:1.0:1777580317.350395:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917492480 00000100:00100000:1.0:1777580317.350667:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917492608 00000100:00100000:1.0:1777580317.350672:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917492608 00000100:00100000:1.0:1777580317.350702:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12105 00000100:00100000:1.0:1777580317.350714:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917492480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.350754:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5556 count 1 00010000:00010000:2.0:1777580317.350768:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.350779:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.350794:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.350799:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.350804:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.350811:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.350824:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02497a21a00) 00010000:00010000:1.0:1777580317.350841:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.350868:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 24 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.350879:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.350881:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.350885:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.350923:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 24 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.350937:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 24 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.350975:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249f2b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917492736:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.351068:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.351091:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12106 00000100:00100000:1.0:1777580317.351306:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3288:x1863919917492608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.351323:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5565 count 1 00010000:00010000:2.0:1777580317.351466:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.352215:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.352230:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4cbcf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.353386:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.354513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.355274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.355329:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758656 00000100:00100000:2.0:1777580317.355343:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758656 00000100:00100000:0.0:1777580317.356897:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758784 00000100:00100000:0.0:1777580317.356913:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758784 00010000:00010000:2.0:1777580317.357393:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 25 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.357449:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4448 00000100:00100000:2.0:1777580317.357464:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946758656:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.357484:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.357490:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 25 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.357517:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 25 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.357550:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.357552:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.357559:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.357582:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.357628:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.357705:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946758656:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 245us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.357714:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4448 00010000:00010000:0.0:1777580317.357974:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 25 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.358032:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.358047:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4449 00010000:00010000:1.0:1777580317.358058:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 25 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.358059:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946758784:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.358072:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.358075:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.358077:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.358089:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.358096:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 25 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.358109:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 25 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.358126:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.358128:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.358154:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.358164:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.358181:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.358207:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946758784:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 153us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.358214:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4449 00010000:00010000:3.0:1777580317.358445:0:205908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac3716e/0xcb2b2f2f7e4b491 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6b4 expref: 24 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.358463:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238639f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917489280:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.358497:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.358508:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.358515:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.358526:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.358535:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.358558:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.359227:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917489152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34204us (34889us total) trans 8589938661 rc 0/0 00000100:00100000:3.0:1777580317.359239:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12091 00010000:00010000:3.0:1777580317.359319:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4b1a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e605 expref: 23 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.359334:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917489408:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.359353:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.359638:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 25 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.359666:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 22 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.359685:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917492864:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.361301:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.361344:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.361354:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.361368:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.361373:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.361385:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.361425:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.361441:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cbe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.361469:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.361471:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.361473:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580317.361535:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc42300/2, rc 0, transno 8589938661 00000100:00100000:1.0:1777580317.361558:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.361679:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917492992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.361754:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.361844:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917492992 00000100:00100000:1.0:1777580317.361853:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917492992 00000100:00100000:1.0:1777580317.361913:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12107 00000100:00100000:1.0:1777580317.361938:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+32:3289:x1863919917492992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.361976:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5559 count 1 00010000:00010000:1.0:1777580317.362005:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.362029:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.362039:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.362042:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.362046:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.362080:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.362108:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.362123:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917493120:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.362956:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738540 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.367201:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.367211:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.367224:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.367233:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.367256:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.368048:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.368071:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.368190:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946758912 00000100:00100000:0.0:1777580317.368204:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946758912 00000100:00100000:1.0:1777580317.368242:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917489536:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.368273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.368282:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.368303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.368329:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 22 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.368331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.368349:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917491328:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.368363:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.368385:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.368392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.368442:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1671500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917491840:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.368456:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.368483:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1671f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917492096:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.368499:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368634:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759040 00000100:00100000:0.0:1777580317.368641:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759040 00000100:00100000:2.0:1777580317.368660:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.368666:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.368681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.368685:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759808 00000100:00100000:0.0:1777580317.368689:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759808 00010000:00010000:0.0:1777580317.368707:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 22 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368721:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759680 00000100:00100000:0.0:1777580317.368724:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759680 00010000:00010000:0.0:1777580317.368738:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368750:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759168 00000100:00100000:0.0:1777580317.368753:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759168 00010000:00010000:0.0:1777580317.368769:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368796:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759424 00000100:00100000:0.0:1777580317.368800:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759424 00000100:00100000:2.0:1777580317.368809:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238639c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:207637:1863919917491968:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.368817:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 24 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.368828:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368830:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759936 00000100:00100000:0.0:1777580317.368841:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759936 00000100:00100000:2.0:1777580317.368854:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759296 00000100:00100000:2.0:1777580317.368859:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759296 00010000:00010000:0.0:1777580317.368859:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 25 pid: 206352 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368877:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946759552 00010000:00010000:2.0:1777580317.368881:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 26 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.368883:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946759552 00010000:00010000:0.0:1777580317.368903:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 24 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.368910:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4450 00000100:00100000:2.0:1777580317.368924:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2363:x1863919946758912:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.368944:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.368958:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 24 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.368971:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 24 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.368998:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4b1b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e613 expref: 24 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.369017:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.369019:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.369025:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.369034:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.369067:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.369333:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.369345:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.369345:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4451 00000100:00100000:0.0:1777580317.369357:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946759040:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.369358:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.369370:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369373:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.369380:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369392:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 23 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.369395:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580317.369409:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369412:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369415:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369423:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369440:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.369468:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946758912:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 545us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.369477:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946759040:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 122us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.369482:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4450 00000100:00100000:0.0:1777580317.369492:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4451 00000100:00100000:2.0:1777580317.369512:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4452 00000100:00100000:2.0:1777580317.369522:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946759808:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777580317.369528:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4453 00010000:00010000:2.0:1777580317.369532:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.369541:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.369541:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946759680:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.369557:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.369564:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369575:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369591:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4b7b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e78d expref: 25 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369604:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369606:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369609:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369616:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369641:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580317.369649:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.369667:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4b4bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d7 expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.369671:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946759680:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 131us (1365us total) trans 0 rc 0/0 00010000:00010000:2.0:1777580317.369687:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1777580317.369687:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4453 00010000:00010000:2.0:1777580317.369691:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.369695:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.369706:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.369718:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4454 00000100:00100000:0.0:1777580317.369725:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946759168:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.369730:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.369735:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.369741:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 25 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369755:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 25 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369769:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369772:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.369809:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369818:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.369832:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.369857:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946759168:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 133us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.369864:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4454 00000100:00100000:0.0:1777580317.369883:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4455 00000100:00100000:0.0:1777580317.369890:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946759424:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.369899:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.369905:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 24 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.369997:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946759808:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 476us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.370005:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4452 00010000:00010000:0.0:1777580317.370037:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 23 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.370053:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.370055:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.370058:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.370067:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4456 00010000:00010000:0.0:1777580317.370067:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.370075:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946759936:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.370084:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.370260:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 23 pid: 206352 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.370282:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 23 pid: 206352 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.370297:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4baf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e890 expref: 23 pid: 206352 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.370325:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.370328:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.370330:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580317.370331:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.370340:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.370364:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.382187:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+34:3291:x1863919917489024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56980us (57618us total) trans 8589938662 rc 0/0 00000100:00100000:3.0:1777580317.382207:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12092 00010000:00010000:3.0:1777580317.383577:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580317.383593:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383609:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.383614:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383626:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383673:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383681:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cbeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383707:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.383712:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383719:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69be600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.383722:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383729:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383738:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.383744:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6404067/0xcb2b2f2f7e4cbf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.385876:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.385884:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.385910:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580317.386002:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc40700/2, rc 0, transno 8589938662 00000100:00100000:3.0:1777580317.386043:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.386058:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4457 00010000:00010000:3.0:1777580317.386065:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.386088:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2362:x1863919946759296:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777580317.386110:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386115:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.386126:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386128:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 22 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386170:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386178:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.386180:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 22 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386184:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386202:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386221:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f700) 00010000:00010000:3.0:1777580317.386225:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.386231:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386238:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cc62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386297:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4b498 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6bb expref: 22 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.386311:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917491584:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.386343:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386350:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.386353:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.386359:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386379:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386403:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e72234d/0xcb2b2f2f7e4b4b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6de expref: 21 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.386415:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917490304:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.386415:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.386433:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386443:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386449:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386459:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.386465:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.386474:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946759296:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 401us (17811us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.386483:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4457 00010000:00010000:3.0:1777580317.386487:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.386518:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4458 00000100:00100000:0.0:1777580317.386528:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946759552:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.386538:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.386544:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 20 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386555:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 20 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386572:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd04468/0xcb2b2f2f7e4b49f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c9 expref: 20 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386596:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.386599:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.386602:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386610:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386631:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.386651:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946759552:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 126us (17972us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.386659:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4458 00010000:00010000:0.0:1777580317.386701:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4b1ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e60c expref: 20 pid: 205907 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.386712:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917491456:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.386733:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386742:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386749:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386769:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386777:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.386805:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580317.387093:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917489664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50443us (51072us total) trans 8589939061 rc 0/0 00000100:00100000:0.0:1777580317.387102:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12097 00000100:00100000:3.0:1777580317.387161:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+34:3291:x1863919917490048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52668us (53055us total) trans 8589938664 rc 0/0 00000100:00100000:3.0:1777580317.387170:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12094 00010000:00010000:3.0:1777580317.387195:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580317.387208:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387217:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.387220:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387229:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387245:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387252:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cbf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387272:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.387276:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387284:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.387287:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387294:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387320:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387327:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cc0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387343:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.387346:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.387348:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580317.387376:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc40000/2, rc 0, transno 8589938664 00000100:00100000:3.0:1777580317.387384:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917490048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.387407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.387420:0:206023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f7d789/0xcb2b2f2f7e4b4ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6c2 expref: 19 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.387434:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917490432:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.387452:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387461:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387469:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387491:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.387499:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.387511:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.387517:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.387724:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+33:3291:x1863919917489920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52973us (53430us total) trans 8589939062 rc 0/0 00000100:00100000:3.0:1777580317.387733:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12095 00000100:00100000:3.0:1777580317.387754:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760064 00000100:00100000:3.0:1777580317.387762:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760064 00000100:00100000:0.0:1777580317.387775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.387816:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.387821:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12108 00000100:00100000:3.0:1777580317.387832:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2362:x1863919946760064:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580317.387846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.387889:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.387913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.387932:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.387952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.388009:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.388015:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388024:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.388028:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388047:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388061:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388068:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cc00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388085:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.388089:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.388092:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.388100:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946760064:12345-192.168.202.9@tcp:2:touch.500 Request processed in 270us (695us total) trans 8589939063 rc 0/0 00000100:00100000:3.0:1777580317.388108:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12108 00000004:00080000:0.0:1777580317.388124:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc41c00/2, rc 0, transno 8589939061 00010000:00010000:3.0:1777580317.388132:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.388163:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917489664:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1777580317.388188:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc41500/2, rc 0, transno 8589939062 00000100:00100000:0.0:1777580317.388192:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760320 00000100:00100000:3.0:1777580317.388196:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917489920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.388197:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760320 00000100:00100000:0.0:1777580317.388225:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838290879295 time 7838291049215 state 0x0 ref 1 00000100:00100000:0.0:1777580317.388237:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838291149215 time 7838291049215 state 0x1 ref 1 00000100:00100000:0.0:1777580317.388253:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760960 00000100:00100000:0.0:1777580317.388256:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760960 00000100:00100000:0.0:1777580317.388266:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838291149215 time 7838291049215 state 0x1 ref 2 00000100:00100000:0.0:1777580317.388284:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838337246345 time 7838337146345 state 0x1 ref 2 00000100:00100000:0.0:1777580317.388294:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+85:283428:x1863919946760320:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.388319:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.388338:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cc85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec80 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388485:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388503:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388515:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388530:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388537:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.388543:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.389072:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f3:0x0], index 0: 0 00010000:00010000:0.0:1777580317.389285:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cc9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389297:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389306:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cc9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389359:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389367:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389374:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389380:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.389385:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389391:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389403:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.389405:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.389410:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389416:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4cc8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.389433:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ce289744 reply state 000000000d2b5e53 transno 8589950973 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.389443:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.389478:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cc85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec80 expref: 88 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389506:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cc9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec80 expref: 87 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.389515:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0249f66fa00) 00010000:00010000:0.0:1777580317.389518:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.389520:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248784ca00, rc 0) 00000100:00100000:1.0:1777580317.389698:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917488896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 64400us (65006us total) trans 8589938663 rc 0/0 00000100:00100000:1.0:1777580317.389717:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12093 00000100:00100000:2.0:1777580317.389765:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760704 00000100:00100000:2.0:1777580317.389774:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760704 00010000:00010000:2.0:1777580317.389820:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 25 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.389845:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760832 00000100:00100000:2.0:1777580317.389849:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760832 00010000:00010000:2.0:1777580317.389868:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 19 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.389882:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760448 00000100:00100000:2.0:1777580317.389894:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760448 00010000:00010000:2.0:1777580317.389914:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 25 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.389933:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946760576 00000100:00100000:2.0:1777580317.389937:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946760576 00010000:00010000:2.0:1777580317.389953:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.389969:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946761088 00000100:00100000:2.0:1777580317.389972:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946761088 00010000:00010000:2.0:1777580317.389986:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 19 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.389998:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946761216 00000100:00100000:1.0:1777580317.389999:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1670000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917492224:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.390003:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946761216 00010000:00010000:2.0:1777580317.390020:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 27 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.390032:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.390038:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4459 00000100:00100000:2.0:1777580317.390053:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946760704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.390068:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777580317.390072:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917492352:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.390075:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 27 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.390091:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.390117:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:206352:1863919917493120:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.391286:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.391304:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 27 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.391351:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917493248:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580317.391364:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.391367:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.391374:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.391385:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.391413:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.391473:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946760704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1422us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.391483:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4459 00000100:00100000:0.0:1777580317.391500:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283428:x1863919946760320:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3203us (3986us total) trans 8589950973 rc 0/0 00000100:00100000:0.0:1777580317.391513:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19805 00000100:00100000:2.0:1777580317.391542:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4460 00000100:00100000:0.0:1777580317.391551:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838337246345 time 7838340410504 state 0x0 ref 1 00000100:00100000:2.0:1777580317.391556:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946760832:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777580317.391572:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+87:283423:x1863919946760960:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.391595:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.391620:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4cca8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec87 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.391690:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec87 expref: 88 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.391699:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777580317.391706:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4cca8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec87 expref: 88 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.391729:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:0.0:1777580317.391733:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.391737:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030400, rc 0) 00000100:00100000:1.0:1777580317.391750:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580317.391760:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917493376:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580317.391770:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777580317.391776:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+88:283423:x1863919946760960:12345-192.168.202.9@tcp:101:touch.500 Request processed in 206us (3928us total) trans 0 rc 0/0 00010000:00010000:2.0:1777580317.391789:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 19 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.391802:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19806 00000100:00100000:1.0:1777580317.391804:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777580317.391812:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 19 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.391812:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838337246345 time 7838340410504 state 0x2 ref 0 00010000:00010000:2.0:1777580317.391837:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.391839:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580317.391839:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917493248 00010000:00010000:2.0:1777580317.391845:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.391849:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917493248 00010000:00010000:2.0:1777580317.391868:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.391882:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.391887:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917493376 00000100:00100000:0.0:1777580317.391887:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917491712:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.391892:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917493376 00000100:00100000:2.0:1777580317.391911:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946760832:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 359us (4094us total) trans 0 rc 0/0 00010000:00010000:0.0:1777580317.391914:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.391923:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4460 00000100:00100000:1.0:1777580317.391923:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12109 00000100:00100000:1.0:1777580317.391936:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3290:x1863919917493248:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580317.391949:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4461 00000100:00100000:2.0:1777580317.391960:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946760448:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.391970:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1777580317.391973:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5566 count 1 00010000:00010000:2.0:1777580317.391979:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 25 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.391991:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 25 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.391995:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.392006:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4747693/0xcb2b2f2f7e4b6ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e739 expref: 25 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.392016:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 18 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.392023:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.392027:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.392028:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.392031:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.392033:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.392035:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.392067:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.392084:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 18 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.392099:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 18 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.392112:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917493504:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.392362:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917493632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580317.393364:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.395330:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738540 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.395366:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.395383:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.395771:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.395781:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.395826:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580317.395879:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.395889:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.395914:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee9200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.395919:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.395929:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.395954:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.395962:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bed722d5/0xcb2b2f2f7e4cc38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.395988:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.395997:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.396000:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.396195:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946760448:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4227us (8295us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.396208:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4461 00000100:00100000:2.0:1777580317.396255:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4462 00000100:00100000:2.0:1777580317.396270:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2363:x1863919946760576:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.396292:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.396301:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396316:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396334:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4b7af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e77f expref: 26 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396348:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396350:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396356:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396382:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396422:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.396455:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946760576:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 191us (8541us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.396462:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4462 00000100:00100000:2.0:1777580317.396480:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4463 00000100:00100000:2.0:1777580317.396487:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2363:x1863919946761088:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.396496:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.396502:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 19 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396525:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 19 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396541:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034240b46/0xcb2b2f2f7e4b4a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e6d0 expref: 19 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396551:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396552:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396556:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396587:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396609:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.396624:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2363:x1863919946761088:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 138us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.396631:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4463 00000100:00100000:2.0:1777580317.396646:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4464 00000100:00100000:2.0:1777580317.396654:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946761216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.396664:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.396670:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396680:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396693:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000534ab070/0xcb2b2f2f7e4b9fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e83c expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396703:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396705:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.396708:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396727:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396747:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.396764:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2364:x1863919946761216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 110us (8810us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.396770:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4464 00010000:00010000:2.0:1777580317.396814:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396823:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396830:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396835:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.396840:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396847:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396860:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02487fb4f00) 00010000:00010000:2.0:1777580317.396864:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.396869:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.396875:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4cc4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.396934:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.396945:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.396954:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.396973:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.396991:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580317.397008:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3290:x1863919917490816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57539us (58550us total) trans 8589939064 rc 0/0 00000100:00100000:1.0:1777580317.397021:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12103 00000100:00100000:1.0:1777580317.397048:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12110 00000100:00100000:1.0:1777580317.397059:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3290:x1863919917493376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.397092:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5558 count 1 00010000:00010000:2.0:1777580317.397218:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397228:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397236:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397243:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397259:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580317.397598:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+35:3289:x1863919917492992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35666us (35846us total) trans 8589938665 rc 0/0 00000100:00100000:2.0:1777580317.397607:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12107 00010000:00010000:2.0:1777580317.397638:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397648:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397656:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397676:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397693:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580317.397863:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917491072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59129us (60789us total) trans 8589939065 rc 0/0 00000100:00100000:2.0:1777580317.397869:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12100 00010000:00010000:2.0:1777580317.397891:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777580317.397898:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397906:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.397910:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397918:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397934:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397941:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4cc3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397960:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580317.397970:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397977:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fcc00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.397980:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397987:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.397997:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398005:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebb966bd/0xcb2b2f2f7e4cc7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398020:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.398024:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398030:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.398033:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398041:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398066:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398072:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c0d96/0xcb2b2f2f7e4cc2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398090:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398092:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398094:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398102:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398115:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398124:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398162:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398171:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398189:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.398353:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917490560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60696us (61583us total) trans 8589939066 rc 0/0 00000100:00100000:2.0:1777580317.398372:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12099 00010000:00010000:2.0:1777580317.398397:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.398402:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398411:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.398414:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398421:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398434:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398441:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4cc1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.398458:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398460:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.398462:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.398525:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2362:x1863919946759936:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 28447us (30133us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.398535:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4456 00010000:00010000:1.0:1777580317.399658:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.399690:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 22 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.399705:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 18 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.399713:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.399717:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.399722:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.399811:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 18 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.399824:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.399829:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 18 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.399849:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.399862:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.399863:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917493888:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.399877:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.399899:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.399992:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 22 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400004:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 22 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.400014:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917494016:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.400042:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000004:00080000:1.0:1777580317.400106:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02486243800/2, rc 0, transno 8589939064 00000100:00100000:1.0:1777580317.400122:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917490816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580317.400324:0:206018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000080058a/0xcb2b2f2f7e4b7e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e794 expref: 22 pid: 205905 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.400342:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249f2b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917492736:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.400368:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400388:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400395:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400486:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400494:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.400512:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777580317.401516:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+35:3291:x1863919917492480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50800us (51736us total) trans 8589938666 rc 0/0 00000100:00100000:1.0:1777580317.401531:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12105 00000100:00100000:0.0:1777580317.401622:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3290:x1863919917490688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62332us (63267us total) trans 8589939067 rc 0/0 00000100:00100000:0.0:1777580317.401630:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12102 00010000:00010000:0.0:1777580317.401681:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580317.401691:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401703:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.401709:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401718:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401742:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401751:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b62b16/0xcb2b2f2f7e4cc31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580317.401769:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1673b80/2, rc 0, transno 8589938666 00010000:00010000:0.0:1777580317.401777:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.401795:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.401797:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917492480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.401809:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.401812:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401819:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401847:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401854:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c0f3d2/0xcb2b2f2f7e4cc70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401871:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.401873:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.401875:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580317.401921:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239e024000/2, rc 0, transno 8589939067 00000100:00100000:0.0:1777580317.401928:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239e024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917490688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580317.401963:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401973:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401984:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.401992:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402011:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.402212:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917490944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 63355us (63954us total) trans 8589939068 rc 0/0 00000100:00100000:0.0:1777580317.402226:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12101 00010000:00010000:0.0:1777580317.402251:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.402257:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402265:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bf600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.402268:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402276:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402289:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402297:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006539bd7e/0xcb2b2f2f7e4cc23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402309:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.402311:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.402312:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.402333:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917493760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.402377:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777580317.402416:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cf9f80/2, rc 0, transno 8589938665 00000100:00100000:0.0:1777580317.402422:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917492992:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580317.402430:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02486242680/2, rc 0, transno 8589939068 00000100:00100000:0.0:1777580317.402441:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490944:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580317.402453:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239e024a80/2, rc 0, transno 8589939066 00000100:00100000:0.0:1777580317.402457:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239e024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490560:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580317.402465:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1672680/2, rc 0, transno 8589939065 00000100:00100000:0.0:1777580317.402468:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917491072:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580317.402479:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc40e00/2, rc 0, transno 8589938663 00000100:00100000:0.0:1777580317.402483:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917488896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.402506:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402516:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402524:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402532:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.402546:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.402687:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917489792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66228us (67597us total) trans 8589939069 rc 0/0 00000100:00100000:0.0:1777580317.402695:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12096 00000100:00100000:0.0:1777580317.402714:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917493760 00000100:00100000:0.0:1777580317.402721:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917493760 00000100:00100000:0.0:1777580317.402776:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12111 00000100:00100000:0.0:1777580317.402798:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3289:x1863919917493760:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.402915:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917494272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.402946:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.402974:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777580317.402982:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917494144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.403000:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1777580317.403011:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5601 count 1 00010000:00010000:0.0:1777580317.403041:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403049:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4bdc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e94d expref: 18 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403065:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 23 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403077:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580317.403078:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917492864:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.403081:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.403086:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403105:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403117:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403122:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 23 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403167:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403168:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 23 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.403190:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917494528:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.403260:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290c00 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.403271:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403276:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.403284:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403284:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403306:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a69bec00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.403315:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580317.403319:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403328:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403343:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403351:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3aba8a/0xcb2b2f2f7e4cc07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.403370:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.403373:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.403831:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3288:x1863919917492608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52528us (53497us total) trans 8589938667 rc 0/0 00000100:00100000:1.0:1777580317.403840:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12106 00000100:00100000:1.0:1777580317.403863:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917494272 00000100:00100000:1.0:1777580317.403869:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917494272 00000100:00100000:1.0:1777580317.403897:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917494144 00000100:00100000:1.0:1777580317.403899:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917494144 00000100:00100000:1.0:1777580317.403917:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12112 00000100:00100000:1.0:1777580317.403934:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3291:x1863919917494272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580317.403953:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5561 count 1 00010000:00010000:1.0:1777580317.403972:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403989:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.403998:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.403999:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.404003:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.404033:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.404038:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.404043:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.404050:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.404061:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 21 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.404067:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.404078:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87baa61/0xcb2b2f2f7e4cc77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.404080:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917494656:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.404106:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.404109:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.404111:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.404121:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738600 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.404160:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580317.404199:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc43100/2, rc 0, transno 8589939069 00000100:00100000:0.0:1777580317.404205:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917489792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.404213:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580317.404224:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917494400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.404260:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.404621:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917494912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.404656:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.404674:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917495424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.404695:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.404716:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777580317.404723:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917495040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.404742:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.404771:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917494400 00000100:00100000:0.0:1777580317.404777:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917494400 00000100:00100000:0.0:1777580317.404927:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917494912 00000100:00100000:0.0:1777580317.404931:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917494912 00000100:00100000:0.0:1777580317.404959:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917495424 00000100:00100000:0.0:1777580317.404962:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917495424 00000100:00100000:0.0:1777580317.404970:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917495040 00000100:00100000:0.0:1777580317.404972:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917495040 00000100:00100000:0.0:1777580317.404984:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12113 00000100:00100000:0.0:1777580317.404992:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3291:x1863919917494144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580317.405025:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5560 count 1 00010000:00010000:0.0:1777580317.405048:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.405068:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 21 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.405076:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.405078:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.405080:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.405106:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 21 pid: 206018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.405118:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 21 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.405130:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917495552:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.405232:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290180 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.405266:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12114 00000100:00100000:0.0:1777580317.405274:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3289:x1863919917494400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580317.405287:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5563 count 1 00010000:00010000:0.0:1777580317.406712:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.406772:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 21 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.406780:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.406796:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.406800:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.406839:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12115 00010000:00010000:0.0:1777580317.406853:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 21 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.406864:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+36:3290:x1863919917494912:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580317.406868:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 21 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.406887:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917495680:192.168.202.9@tcp:104: 00002000:00080000:1.0:1777580317.406900:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5596 count 1 00010000:00010000:1.0:1777580317.406926:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.406958:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.406966:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.406968:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.406970:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.406998:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.406999:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290600 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.407039:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917494784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.407090:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.407116:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917495296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.407155:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.407176:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580317.407182:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917495168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.407199:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.407334:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917494784 00000100:00100000:0.0:1777580317.407349:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917494784 00000100:00100000:0.0:1777580317.407404:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917495296 00000100:00100000:0.0:1777580317.407407:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917495296 00000100:00100000:0.0:1777580317.407418:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917495168 00000100:00100000:0.0:1777580317.407420:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917495168 00000100:00100000:0.0:1777580317.407433:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12116 00000100:00100000:0.0:1777580317.407440:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+39:3290:x1863919917495424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.407454:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5603 count 1 00010000:00010000:0.0:1777580317.407469:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407483:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407490:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.407491:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.407494:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407514:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407524:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.407535:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917495936:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.407571:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4ebb40 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.407593:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407611:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407623:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407631:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.407655:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.409362:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 23 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.409392:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02395cf8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917495808:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.410017:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.410028:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.410051:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.410057:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.410070:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.410108:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.410172:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12117 00000100:00100000:1.0:1777580317.410201:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3290:x1863919917495040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580317.410243:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5599 count 1 00010000:00010000:1.0:1777580317.410292:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.410314:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 23 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.410314:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3289:x1863919917490176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 73364us (74236us total) trans 8589938668 rc 0/0 00000100:00100000:0.0:1777580317.410333:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12098 00010000:00010000:1.0:1777580317.410346:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.410349:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.410353:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.410366:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.410368:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12118 00010000:00010000:2.0:1777580317.410379:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cc15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.410380:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917494784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.410401:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5597 count 1 00010000:00010000:2.0:1777580317.410414:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.410418:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.410418:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.410423:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.410435:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.410442:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12119 00010000:00010000:0.0:1777580317.410448:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.410450:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.410453:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.410456:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917495296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580317.410473:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5604 count 1 00010000:00010000:2.0:1777580317.410489:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.410493:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.410509:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 23 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.410523:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917496192:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.410555:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023916230c0 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.410570:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580317.410629:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249dc40a80/2, rc 0, transno 8589938668 00000100:00100000:0.0:1777580317.410645:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249dc40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917490176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.410717:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917496320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.410750:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.410904:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917496320 00000100:00100000:0.0:1777580317.410912:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917496320 00010000:00010000:2.0:1777580317.411379:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 23 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.411405:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.411407:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.411410:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.411436:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 23 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.411447:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 23 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.411460:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917496448:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.411710:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12120 00000100:00100000:0.0:1777580317.411724:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917495168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580317.411745:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5598 count 1 00010000:00010000:0.0:1777580317.411765:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.411779:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 23 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.411802:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+39:3290:x1863919917491200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 72084us (73401us total) trans 8589938669 rc 0/0 00000100:00100000:3.0:1777580317.411816:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12104 00000100:00100000:3.0:1777580317.411837:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12121 00000100:00100000:3.0:1777580317.411844:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+38:3291:x1863919917496320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580317.411857:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5567 count 1 00010000:00010000:3.0:1777580317.411871:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.411892:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.411894:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 17 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.411895:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.411900:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.411906:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.411910:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.411914:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.411934:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 23 pid: 193009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.411939:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 17 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.411949:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 17 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.411970:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917496704:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.412007:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4c300 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.412034:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580317.412067:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023d1670a80/2, rc 0, transno 8589938669 00000100:00100000:3.0:1777580317.412081:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917491200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.412096:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 23 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.412110:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917496576:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.412112:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 23 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.412159:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 23 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.412175:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02391623180 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.412176:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249f2b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917496064:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.412177:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777580317.412194:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917496832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.412231:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.412244:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580317.412258:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917496832 00000100:00100000:2.0:1777580317.412264:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.412265:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917496832 00000100:00100000:0.0:1777580317.412272:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.412291:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946761344 00000100:00100000:3.0:1777580317.412297:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946761344 00000100:00100000:1.0:1777580317.412301:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12122 00000100:00100000:1.0:1777580317.412313:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3289:x1863919917496832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580317.412316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.412332:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12123 00002000:00080000:1.0:1777580317.412332:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5562 count 1 00000100:00100000:3.0:1777580317.412346:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2362:x1863919946761344:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580317.412353:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.412410:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946761600 00000100:00100000:2.0:1777580317.412415:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946761600 00000100:00100000:2.0:1777580317.412452:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4241 00000100:00100000:2.0:1777580317.412458:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+87:283420:x1863919946761600:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580317.412619:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2362:x1863919946761344:12345-192.168.202.9@tcp:2:touch.500 Request processed in 273us (347us total) trans 8589938670 rc 0/0 00000100:00100000:0.0:1777580317.412619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.412631:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12123 00000100:00100000:0.0:1777580317.412653:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946761856 00000100:00100000:0.0:1777580317.412657:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946761856 00000100:00100000:0.0:1777580317.412680:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838337246345 time 7838340410504 state 0x0 ref 1 00000100:00100000:0.0:1777580317.412691:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838340510504 time 7838340410504 state 0x1 ref 1 00000100:00100000:0.0:1777580317.413192:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762112 00000100:00100000:0.0:1777580317.413197:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762112 00000100:00100000:0.0:1777580317.413215:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838340510504 time 7838340410504 state 0x1 ref 2 00000100:00100000:0.0:1777580317.413351:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362313410 time 7838362213410 state 0x1 ref 2 00000100:00100000:0.0:1777580317.413364:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+89:283428:x1863919946761856:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580317.413403:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.413430:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4cc9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec80 expref: 89 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.413451:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0249f66fa00) 00010000:00010000:0.0:1777580317.413461:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.413526:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.413540:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.413549:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.413672:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000056ff3548 reply state 00000000766c410c transno 8589950974 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.413680:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.413755:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+90:283428:x1863919946761856:12345-192.168.202.9@tcp:36:touch.500 Request processed in 394us (1402us total) trans 8589950974 rc 0/0 00000100:00100000:0.0:1777580317.413762:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19807 00000100:00100000:0.0:1777580317.413797:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362313410 time 7838362660283 state 0x0 ref 1 00000100:00100000:0.0:1777580317.413807:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+90:283427:x1863919946762112:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.413908:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.413924:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4cd11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec8e expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.413932:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+90:283420:x1863919946761600:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1471us (1618us total) trans 8589950975 rc 0/0 00000100:00100000:2.0:1777580317.413944:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4241 00010000:00010000:0.0:1777580317.414276:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.414290:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.414301:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.414317:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.414324:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.414331:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.415209:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15cf:0x0], index 1: 0 00010000:00010000:0.0:1777580317.415416:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4cd26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415431:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415441:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4cd26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415502:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415510:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415516:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415523:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.415527:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415536:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415547:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.415551:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.415556:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415563:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd18 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.415580:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000064c9be10 reply state 000000000bfa2542 transno 8589950976 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.415588:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.415626:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4cd11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec8e expref: 92 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415656:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4cd26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec8e expref: 91 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.415664:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa0249f66fe00) 00010000:00010000:0.0:1777580317.415666:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.415668:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389020800, rc 0) 00010000:00010000:1.0:1777580317.419704:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.419750:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 22 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.419761:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.420982:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.420990:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.421473:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+92:283427:x1863919946762112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7656us (8847us total) trans 8589950976 rc 0/0 00000100:00100000:0.0:1777580317.421487:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19808 00000100:00100000:0.0:1777580317.421497:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362313410 time 7838362660283 state 0x2 ref 0 00000100:00100000:0.0:1777580317.422105:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777580317.422243:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249f2b8000/2, rc 0, transno 8589938667 00000100:00100000:0.0:1777580317.422265:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249f2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917492608:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580317.422346:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 22 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.422367:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 22 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.422378:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917496960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580317.422384:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917497088:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580317.422433:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580317.422492:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946759424:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 52602us (54132us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.422503:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4455 00000100:00100000:1.0:1777580317.422904:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580317.425394:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.425540:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.425568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.425590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.425610:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.425630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.425762:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917493504:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.425824:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.425882:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.425905:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917493888:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.425921:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917494016:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.425941:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.425972:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917494656:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.425985:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.426349:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.426766:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:205898:1863919917494528:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.426804:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.426909:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917495552:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.426936:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.427533:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917493632 00000100:00100000:0.0:1777580317.427543:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917495936:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.427556:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917493632 00010000:00010000:0.0:1777580317.427564:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.427593:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762240 00000100:00100000:0.0:1777580317.427597:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762240 00010000:00010000:0.0:1777580317.427633:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 18 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.427657:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762368 00000100:00100000:0.0:1777580317.427661:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762368 00010000:00010000:0.0:1777580317.427675:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 19 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.427687:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762624 00000100:00100000:0.0:1777580317.427691:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762624 00010000:00010000:0.0:1777580317.427704:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 24 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.427716:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762880 00000100:00100000:0.0:1777580317.427719:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762880 00010000:00010000:0.0:1777580317.427734:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 23 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.427760:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763136 00000100:00100000:0.0:1777580317.427763:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763136 00010000:00010000:0.0:1777580317.427777:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 25 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.428313:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917496960 00000100:00100000:3.0:1777580317.428321:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917496960 00000100:00100000:3.0:1777580317.428372:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12124 00000100:00100000:3.0:1777580317.428385:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+40:3288:x1863919917493632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580317.428428:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5595 count 1 00010000:00010000:3.0:1777580317.428462:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.428486:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 25 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.428496:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.428498:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.428502:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.428539:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762496 00000100:00100000:0.0:1777580317.428544:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762496 00010000:00010000:3.0:1777580317.428550:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 25 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.428567:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.428569:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 25 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.428594:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946762752 00000100:00100000:0.0:1777580317.428598:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946762752 00000100:00100000:3.0:1777580317.428604:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238639f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917497216:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.428615:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 25 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.428630:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763008 00000100:00100000:0.0:1777580317.428633:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763008 00010000:00010000:0.0:1777580317.428648:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 26 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.428662:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4465 00000100:00100000:0.0:1777580317.428669:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946762240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.428681:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.428687:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 19 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.428719:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248bb4c780 going to sleep for 11 seconds 00010000:00010000:0.0:1777580317.428733:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 19 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.428754:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12125 00000100:00100000:3.0:1777580317.428763:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3289:x1863919917496960:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.428765:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4bde4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e954 expref: 19 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.428795:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.428797:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.428802:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.428811:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.428853:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.428887:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2362:x1863919946762240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 217us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.428895:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4465 00000100:00100000:0.0:1777580317.428918:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4466 00000100:00100000:0.0:1777580317.428925:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2362:x1863919946762368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.428933:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429039:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 17 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429062:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 17 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429074:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4be31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e962 expref: 17 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429086:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.429106:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946762368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 182us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.429112:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4466 00000100:00100000:0.0:1777580317.429127:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4467 00000100:00100000:0.0:1777580317.429159:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946762624:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.429170:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429176:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 25 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429186:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 25 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429199:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e0c9ff/0xcb2b2f2f7e4bd74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e93f expref: 25 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429230:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429254:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429259:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429266:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429285:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.429307:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2362:x1863919946762624:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 173us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.429314:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4467 00000100:00100000:0.0:1777580317.429374:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4468 00000100:00100000:0.0:1777580317.429393:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946762880:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.429401:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429408:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 26 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429418:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 26 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429432:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4ba17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e84a expref: 26 pid: 206018 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429443:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429444:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429447:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429499:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429520:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.429543:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946762880:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 152us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.429550:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4468 00000100:00100000:0.0:1777580317.429565:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4469 00000100:00100000:0.0:1777580317.429573:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2362:x1863919946763136:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.429582:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429588:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429597:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429610:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a2c449/0xcb2b2f2f7e4c1b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea0a expref: 23 pid: 206021 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429620:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429622:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429625:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429660:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429679:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.429698:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2362:x1863919946763136:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 126us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.429704:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4469 00000100:00100000:0.0:1777580317.429720:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4470 00000100:00100000:0.0:1777580317.429728:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2362:x1863919946762496:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.429736:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429740:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429751:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429763:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13bb10b/0xcb2b2f2f7e4b9ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e820 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429772:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429774:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429776:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429808:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429829:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.429850:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2362:x1863919946762496:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 124us (4219us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.429856:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4470 00000100:00100000:0.0:1777580317.429871:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4471 00000100:00100000:0.0:1777580317.429878:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2362:x1863919946762752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.429886:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.429891:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 22 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429901:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 22 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429914:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4ba25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e858 expref: 22 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.429925:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429927:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.429930:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1777580317.430072:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5564 count 1 00010000:00010000:3.0:1777580317.430101:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430116:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 21 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430122:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.430123:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.430125:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430174:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 21 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430186:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 21 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.430201:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023850c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917497344:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.430253:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248a0c9540 going to sleep for 11 seconds 00010000:00010000:3.0:1777580317.430287:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430296:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430302:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430319:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784c000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.430325:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430334:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430347:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0249f66f800) 00010000:00010000:3.0:1777580317.430351:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.430355:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.430361:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4cc93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430572:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430594:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.430615:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2362:x1863919946762752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 738us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.430623:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4471 00000100:00100000:0.0:1777580317.430645:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4472 00000100:00100000:0.0:1777580317.430652:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946763008:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.430662:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.430667:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430678:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430693:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.430694:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.430698:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430707:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430716:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.430734:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946763008:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 83us (4386us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.430740:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4472 00010000:00010000:0.0:1777580317.430775:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430796:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430805:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430812:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.430829:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580317.434548:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+41:3290:x1863919917493248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42603us (42838us total) trans 8589938671 rc 0/0 00000100:00100000:0.0:1777580317.434565:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12109 00010000:00010000:0.0:1777580317.434723:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.434740:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.434752:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.434774:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.435383:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580317.435733:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3289:x1863919917493760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32946us (33353us total) trans 8589939070 rc 0/0 00000100:00100000:0.0:1777580317.435743:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12111 00010000:00010000:0.0:1777580317.435803:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.435824:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.435841:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.435850:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.435867:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580317.439176:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3291:x1863919917494144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33931us (35922us total) trans 8589938672 rc 0/0 00000100:00100000:0.0:1777580317.439193:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12113 00010000:00010000:0.0:1777580317.439501:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.439543:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.439560:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.439569:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.439601:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1777580317.442774:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+41:3290:x1863919917495424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35323us (38066us total) trans 8589939071 rc 0/0 00000100:00100000:0.0:1777580317.442805:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12116 00010000:00010000:0.0:1777580317.442884:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580317.442895:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.442911:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.442917:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.442929:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580317.444021:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e4000/2, rc 0, transno 8589939071 00000100:00100000:2.0:1777580317.444052:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917495424:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580317.444074:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cfb100/2, rc 0, transno 8589938671 00000100:00100000:2.0:1777580317.444085:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917493248:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580317.444147:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777580317.444156:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444169:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.444172:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444183:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444209:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444217:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f3be63/0xcb2b2f2f7e4ccbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444250:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777580317.444256:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444263:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.444267:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444274:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444308:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444315:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4cccb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444334:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580317.444339:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444345:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580317.444348:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444355:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444365:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444373:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4cce0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.444389:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.444391:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.444399:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.444939:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917497472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580317.445020:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580317.445076:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777580317.445083:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917497600:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.446194:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.446496:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c5ee99/0xcb2b2f2f7e4ccaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.446525:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.446527:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.446530:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580317.446609:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985fa680/2, rc 0, transno 8589939070 00000100:00100000:0.0:1777580317.446634:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917493760:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580317.446655:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.446807:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580317.446876:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917497472 00000100:00100000:2.0:1777580317.446887:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917497472 00000100:00100000:2.0:1777580317.446942:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917497600 00000100:00100000:2.0:1777580317.446946:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917497600 00000100:00100000:2.0:1777580317.446972:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12126 00000100:00100000:2.0:1777580317.446984:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3290:x1863919917497472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580317.447031:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5602 count 1 00010000:00010000:2.0:1777580317.447061:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.447084:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.450203:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.450218:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.450228:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.451890:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.451910:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 21 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.451944:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917497728:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580317.452072:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580317.452832:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:206020:1863919917495808:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.452871:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.452901:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.452912:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.452927:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.452936:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.452961:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.453860:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12127 00000100:00100000:2.0:1777580317.453880:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+41:3290:x1863919917497600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580317.453924:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5571 count 1 00010000:00010000:2.0:1777580317.453955:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.453980:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 15 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.453989:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.453991:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.453995:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.454041:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 15 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.454055:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 15 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.454072:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023863a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917497856:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580317.454094:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917493376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57037us (62292us total) trans 8589938673 rc 0/0 00000100:00100000:1.0:1777580317.454104:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12110 00000100:00100000:2.0:1777580317.454180:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15180 going to sleep for 11 seconds 00010000:00010000:1.0:1777580317.454777:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.454799:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.454825:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.454831:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.454842:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.454867:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.454875:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896bf62c/0xcb2b2f2f7e4ccb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.454943:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.454945:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.454947:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580317.455008:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cf9880/2, rc 0, transno 8589938673 00000100:00100000:1.0:1777580317.455030:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917493376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580317.455070:0:188248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1f3ab84/0xcb2b2f2f7e4bd66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e923 expref: 19 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.455085:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917495680:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.455108:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.455162:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.455171:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.458202:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.458242:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.458268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.458290:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.459685:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.459713:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.459725:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.459736:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.459741:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.459829:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249f2b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917496064:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.459862:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.459901:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1672300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917497088:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.459923:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.459967:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.460002:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.460012:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.460019:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.460043:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.461020:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461086:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461122:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461167:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461240:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.461307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.463664:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:205896:1863919917496192:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.463711:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.463794:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cfb800/2, rc 0, transno 8589938672 00000100:00100000:0.0:1777580317.463804:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917494144:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.463826:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.463835:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.463845:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.463850:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.463862:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.463956:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.463963:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de108ee1/0xcb2b2f2f7e4ccc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.463990:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.463991:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.463993:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.464107:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763520 00000100:00100000:0.0:1777580317.464115:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763520 00010000:00010000:0.0:1777580317.464177:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 22 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464203:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763776 00000100:00100000:0.0:1777580317.464207:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763776 00010000:00010000:0.0:1777580317.464222:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 23 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464234:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763648 00000100:00100000:0.0:1777580317.464238:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763648 00010000:00010000:0.0:1777580317.464250:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464261:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764288 00000100:00100000:0.0:1777580317.464264:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764288 00010000:00010000:0.0:1777580317.464289:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 25 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464303:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764544 00000100:00100000:0.0:1777580317.464306:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764544 00010000:00010000:0.0:1777580317.464321:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 19 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464333:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764160 00000100:00100000:0.0:1777580317.464336:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764160 00010000:00010000:0.0:1777580317.464351:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 16 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464362:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764416 00000100:00100000:0.0:1777580317.464365:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764416 00010000:00010000:0.0:1777580317.464565:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 26 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464582:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765312 00000100:00100000:0.0:1777580317.464586:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765312 00010000:00010000:0.0:1777580317.464603:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 27 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464612:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765440 00000100:00100000:0.0:1777580317.464615:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765440 00010000:00010000:0.0:1777580317.464629:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.464643:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4473 00000100:00100000:0.0:1777580317.464662:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946763520:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.464680:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.464685:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 27 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464699:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 27 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464720:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2451/0xcb2b2f2f7e4b9e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e82e expref: 27 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464736:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.464738:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.464744:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464756:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464805:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.464886:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946763520:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 226us (6642us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.464894:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4473 00000100:00100000:0.0:1777580317.464916:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4474 00000100:00100000:0.0:1777580317.464922:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2361:x1863919946763776:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.464929:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.464955:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 25 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464964:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 25 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464976:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.464978:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.464981:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.464988:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465000:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.465020:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2361:x1863919946763776:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 99us (6751us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.465026:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4474 00000100:00100000:0.0:1777580317.465091:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4475 00000100:00100000:0.0:1777580317.465097:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2361:x1863919946763648:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.465105:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.465109:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465119:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465180:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f08475dd/0xcb2b2f2f7e4b9f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e835 expref: 24 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465192:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.465193:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.465196:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465204:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465225:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.465246:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946763648:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 150us (6955us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.465252:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4475 00000100:00100000:0.0:1777580317.465269:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4476 00000100:00100000:0.0:1777580317.465277:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2364:x1863919946764288:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.465286:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.465291:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 22 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465300:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 22 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465329:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.465331:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.465335:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465343:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465357:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.465395:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2364:x1863919946764288:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 119us (5720us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.465402:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4476 00000100:00100000:0.0:1777580317.465422:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4477 00000100:00100000:0.0:1777580317.465429:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2364:x1863919946764544:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.465438:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.465444:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465453:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.465467:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000156f0e9e/0xcb2b2f2f7e4bd5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e91c expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.465515:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3291:x1863919917494272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61580us (62566us total) trans 8589938674 rc 0/0 00000100:00100000:1.0:1777580317.465527:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12112 00000100:00100000:3.0:1777580317.466031:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.466162:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580317.466479:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964941cd/0xcb2b2f2f7e4c180 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9f5 expref: 21 pid: 205908 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.466500:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917496448:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.466534:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.466548:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.466557:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.467183:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765568 00000100:00100000:1.0:1777580317.467195:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765568 00010000:00010000:1.0:1777580317.467243:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 21 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.467272:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765696 00000100:00100000:1.0:1777580317.467276:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765696 00010000:00010000:1.0:1777580317.467292:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 17 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.467309:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4478 00000100:00100000:1.0:1777580317.467321:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2364:x1863919946764160:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.467381:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.467388:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 17 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.467416:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 17 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.467454:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.467457:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.467463:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.467475:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.467500:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580317.467778:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.467797:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.467827:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.468241:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3289:x1863919917495296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57787us (61083us total) trans 8589939072 rc 0/0 00000100:00100000:2.0:1777580317.468252:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12119 00010000:00010000:2.0:1777580317.468302:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468311:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468333:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468340:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ac00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.468347:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468355:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468374:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0249f66f700) 00010000:00010000:2.0:1777580317.468378:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.468383:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468390:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ac00/0xcb2b2f2f7e4cd0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.468452:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4479 00000100:00100000:2.0:1777580317.468468:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2364:x1863919946764416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580317.468484:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580317.468492:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 21 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468508:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 21 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468525:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d27eaf/0xcb2b2f2f7e4bab1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e882 expref: 21 pid: 205898 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.468550:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.468552:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.468557:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.470796:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2364:x1863919946764160:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3443us (11027us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.470814:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4478 00000100:00100000:1.0:1777580317.470870:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4480 00000100:00100000:1.0:1777580317.470891:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2361:x1863919946765312:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.470914:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.470925:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 20 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.470946:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 20 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.470992:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.470995:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471001:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471012:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471041:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.471118:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2361:x1863919946765312:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 238us (9876us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.471124:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4480 00000100:00100000:1.0:1777580317.471163:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4481 00000100:00100000:1.0:1777580317.471173:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aed41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2364:x1863919946765440:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.471186:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.471194:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471206:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 20 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471219:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471220:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471223:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471242:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471257:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.471277:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aed41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2364:x1863919946765440:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 108us (9970us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.471283:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4481 00000100:00100000:1.0:1777580317.471299:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4482 00000100:00100000:1.0:1777580317.471307:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2362:x1863919946765568:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.471315:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.471322:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 19 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471331:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 19 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471342:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471344:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471347:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471354:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471366:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.471392:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2362:x1863919946765568:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 87us (5365us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.471399:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4482 00000100:00100000:1.0:1777580317.471418:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4483 00000100:00100000:1.0:1777580317.471426:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946765696:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.471434:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.471441:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 16 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471453:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 16 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471467:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471469:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.471472:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471480:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471491:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.471507:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946765696:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.471513:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4483 00010000:00010000:1.0:1777580317.471551:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777580317.471591:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580317.471599:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471614:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.471620:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471630:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471643:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471650:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000451a871a/0xcb2b2f2f7e4ccf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471678:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.471682:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471688:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.471691:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471698:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471707:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471750:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4ccd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.471769:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.471771:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.471773:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580317.472927:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.472981:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580317.473040:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2364:x1863919946764416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4573us (12022us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.473049:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4479 00010000:00010000:2.0:1777580317.475761:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4c1d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e9fc expref: 17 pid: 205895 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.475803:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917497728:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.475842:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.475855:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.475862:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.475905:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.475914:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.475954:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580317.476091:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.476101:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.476110:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997fe00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.476115:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.476124:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.476168:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.476175:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cd49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.476203:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.476205:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.476207:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.478044:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478066:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478080:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478089:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478118:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580317.478510:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917495040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 68323us (73761us total) trans 8589939073 rc 0/0 00000100:00100000:1.0:1777580317.478523:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12117 00000004:00080000:1.0:1777580317.478624:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e6680/2, rc 0, transno 8589939073 00000100:00100000:1.0:1777580317.478645:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917495040:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580317.478667:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.478696:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478706:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.478711:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.478717:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917497472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31733us (33694us total) trans 8589939074 rc 0/0 00000100:00100000:2.0:1777580317.478731:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12126 00010000:00010000:1.0:1777580317.478731:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478761:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478769:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006919ac47/0xcb2b2f2f7e4cce7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.478794:0:207637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087335b85/0xcb2b2f2f7e4c507 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eaff expref: 15 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.478807:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.478810:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.478813:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023863a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917497856:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.478814:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580317.478841:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aef90700/2, rc 0, transno 8589939074 00010000:00010000:2.0:1777580317.478845:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.478849:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917497472:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580317.478863:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.478871:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.478880:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.478897:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.478924:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580317.479184:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.479192:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.479201:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.479213:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.479221:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.479236:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.479244:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d7c84e/0xcb2b2f2f7e4cd50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.479260:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.479261:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.479263:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580317.480482:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+42:3290:x1863919917497600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26598us (33663us total) trans 8589938675 rc 0/0 00000004:00080000:1.0:1777580317.480624:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aef92300/2, rc 0, transno 8589938675 00000100:00100000:1.0:1777580317.480654:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917497600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580317.480700:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12127 00010000:00010000:2.0:1777580317.480790:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ba14df/0xcb2b2f2f7e4bd6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e938 expref: 19 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.480810:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023850c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917497344:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.480838:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.480849:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.480856:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.480865:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.480873:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.480914:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580317.481209:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917496960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52446us (58774us total) trans 8589938677 rc 0/0 00000100:00100000:2.0:1777580317.481217:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12125 00010000:00010000:2.0:1777580317.481261:0:206352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c674023/0xcb2b2f2f7e4ba02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e843 expref: 16 pid: 188248 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.481274:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238639f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917497216:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580317.481288:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.481295:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.481303:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.481312:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.481319:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.481340:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777580317.481466:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777580317.481473:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481482:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.481487:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481496:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481519:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.481523:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+42:3288:x1863919917493632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53142us (59422us total) trans 8589939075 rc 0/0 00000100:00100000:2.0:1777580317.481531:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12124 00010000:00010000:3.0:1777580317.481535:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000582ea5df/0xcb2b2f2f7e4cd42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481558:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.481561:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481568:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.481571:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481579:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481589:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481596:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be97b8f/0xcb2b2f2f7e4cd3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.481610:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.481612:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.481614:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.481952:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.481954:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580317.481962:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.481974:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.482016:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580317.482077:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2364:x1863919946764544:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 16647us (22361us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.482086:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4477 00010000:00010000:0.0:1777580317.482225:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004114d0c1/0xcb2b2f2f7e4bd20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e90e expref: 15 pid: 193009 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.482237:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917496576:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.482256:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482449:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006883118f/0xcb2b2f2f7e4bec4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90e977 expref: 14 pid: 206023 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.482483:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917496704:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.482491:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482499:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.482502:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482521:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482529:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482554:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.482554:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482578:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.482579:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.482612:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580317.483019:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+43:3291:x1863919917496320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 71173us (72265us total) trans 8589938678 rc 0/0 00000100:00100000:3.0:1777580317.483028:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12121 00000100:00100000:2.0:1777580317.483421:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765056 00000100:00100000:2.0:1777580317.483433:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765056 00000100:00100000:2.0:1777580317.483493:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4242 00000100:00100000:2.0:1777580317.484230:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+90:283423:x1863919946765056:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.484958:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+91:283423:x1863919946765056:12345-192.168.202.9@tcp:35:touch.500 Request processed in 737us (23788us total) trans 8589950977 rc 0/0 00000100:00100000:2.0:1777580317.484968:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4242 00010000:00010000:2.0:1777580317.485023:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.485035:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.485044:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.485051:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.485057:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.485065:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.486386:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0249f66f200) 00010000:00010000:2.0:1777580317.486397:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.486410:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.486445:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021600/0xcb2b2f2f7e4cd1f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.486870:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.486888:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.486912:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.486922:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.488571:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580317.489858:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3289:x1863919917495168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 78128us (82648us total) trans 8589939076 rc 0/0 00000100:00100000:0.0:1777580317.489873:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12120 00000004:00080000:0.0:1777580317.490187:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239ce09f80/2, rc 0, transno 8589938677 00000100:00100000:0.0:1777580317.490225:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239ce09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917496960:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580317.490249:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e5c00/2, rc 0, transno 8589939076 00000100:00100000:0.0:1777580317.490256:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917495168:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580317.490369:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e7100/2, rc 0, transno 8589939072 00000100:00100000:0.0:1777580317.490377:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917495296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.490389:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580317.490410:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917497984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580317.490465:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777580317.490476:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777580317.490489:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.490529:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239667e300/2, rc 0, transno 8589938678 00000100:00100000:0.0:1777580317.490536:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917496320:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580317.490554:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cf9180/2, rc 0, transno 8589938674 00000100:00100000:0.0:1777580317.490563:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917494272:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1777580317.490566:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b4400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.490571:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.490588:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490600:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580317.490609:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.490613:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.490633:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80d2481/0xcb2b2f2f7e4cd03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490633:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.490640:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490654:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490672:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490681:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4ccfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490709:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.490714:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490721:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.490726:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490735:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490757:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.490953:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.490956:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.490959:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.491295:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917497984 00000100:00100000:3.0:1777580317.491304:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917497984 00010000:00010000:0.0:1777580317.491452:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.491464:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.491476:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.491485:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.491505:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.491940:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.491949:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e93107b/0xcb2b2f2f7e4ccd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.493098:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+43:3290:x1863919917494912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 86238us (88432us total) trans 8589939077 rc 0/0 00000100:00100000:3.0:1777580317.494089:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12128 00000100:00100000:3.0:1777580317.494117:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917497984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580317.494182:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5605 count 1 00010000:00010000:3.0:1777580317.494216:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.494245:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 15 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.494254:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.494276:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.494281:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.494330:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 15 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.494351:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 15 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.494452:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12115 00000100:00100000:1.0:1777580317.494518:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946763392 00000100:00100000:1.0:1777580317.494528:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946763392 00000100:00100000:1.0:1777580317.494889:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362313410 time 7838362660283 state 0x0 ref 1 00000100:00100000:1.0:1777580317.494904:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362760283 time 7838362660283 state 0x1 ref 1 00000100:00100000:1.0:1777580317.494930:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764032 00000100:00100000:1.0:1777580317.494934:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764032 00000100:00100000:1.0:1777580317.494948:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362760283 time 7838362660283 state 0x1 ref 2 00000100:00100000:1.0:1777580317.494961:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946764800 00000100:00100000:1.0:1777580317.494964:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946764800 00000100:00100000:1.0:1777580317.494972:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362760283 time 7838362660283 state 0x1 ref 3 00000100:00100000:0.0:1777580317.495379:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917496832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 83067us (83132us total) trans 8589938679 rc 0/0 00000100:00100000:0.0:1777580317.495390:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12122 00010000:00010000:0.0:1777580317.495428:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.495441:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.495467:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580317.495474:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.495486:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.495499:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02383e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917498112:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580317.495513:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.495522:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8446a80/0xcb2b2f2f7e4cd34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.495550:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.495552:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.495554:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.495601:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765184 00000100:00100000:0.0:1777580317.495609:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765184 00000100:00100000:3.0:1777580317.495624:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0248168b540 going to sleep for 11 seconds 00000100:00100000:0.0:1777580317.502172:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838362760283 time 7838362660283 state 0x1 ref 4 00000100:00100000:0.0:1777580317.502223:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838451183755 time 7838451083755 state 0x1 ref 4 00000100:00100000:0.0:1777580317.502262:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+308:283442:x1863919946763392:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.502314:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.502346:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4cd5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec95 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502636:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502656:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502672:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502690:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502698:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502705:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.502801:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cd73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503183:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cd73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503195:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cd73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.503209:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82e:0x0]: returning size 0 00010000:00010000:0.0:1777580317.503371:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503396:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503403:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503409:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.503414:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503422:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503436:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.503439:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.503445:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503452:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4cd65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503474:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503480:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503486:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503491:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.503502:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503508:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503516:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0249f66fa00) 00010000:00010000:0.0:1777580317.503519:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.503521:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503526:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4cd6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503592:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4cd5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec95 expref: 311 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503607:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cd73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec95 expref: 310 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.503614:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580317.503616:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.503619:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389021200, rc 0) 00000100:00100000:0.0:1777580317.503699:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283442:x1863919946763392:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1462us (45513us total) trans 8589950978 rc 0/0 00000100:00100000:0.0:1777580317.503709:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19809 00000100:00100000:0.0:1777580317.503757:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838452719200 time 7838452619200 state 0x1 ref 3 00000100:00100000:0.0:1777580317.503793:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+92:283427:x1863919946764032:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:3.0:1777580317.511029:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838459977961 time 7838459877961 state 0x1 ref 3 00000100:00100000:3.0:1777580317.511074:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+92:283430:x1863919946764800:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580317.511107:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.511152:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cd81 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ec9c expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512603:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512631:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512648:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512669:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512696:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.512704:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.513534:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.513565:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4cd26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec8e expref: 93 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.513591:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa0249f66fe00) 00010000:00010000:0.0:1777580317.513605:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.513711:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.513724:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.513732:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.513903:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007997e40 reply state 00000000aa70f5e6 transno 8589950979 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.513915:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.514047:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+94:283427:x1863919946764032:12345-192.168.202.9@tcp:36:touch.500 Request processed in 10266us (52958us total) trans 8589950979 rc 0/0 00000100:00100000:0.0:1777580317.514060:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19810 00000100:00100000:0.0:1777580317.514124:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838459977961 time 7838462982855 state 0x0 ref 2 00000100:00100000:0.0:1777580317.514173:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+93:283428:x1863919946765184:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.514188:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.514205:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4cd9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eca3 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514482:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4cd9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eca3 expref: 94 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514500:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4cd9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eca3 expref: 94 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514522:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0248a60e200) 00010000:00010000:0.0:1777580317.514525:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.514527:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9ae00, rc 0) 00000100:00100000:0.0:1777580317.514553:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+94:283428:x1863919946765184:12345-192.168.202.9@tcp:101:touch.500 Request processed in 389us (53358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.514559:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19812 00000004:00080000:0.0:1777580317.514639:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023864a1f80/2, rc 0, transno 8589938679 00000100:00100000:0.0:1777580317.514663:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023864a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917496832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580317.514719:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.514750:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514761:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514772:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514792:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.514823:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1777580317.515103:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f4:0x0], index 0: 0 00010000:00010000:3.0:1777580317.515385:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cda4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515397:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cda4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515406:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cda4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515449:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515456:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515463:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515470:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.515475:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515483:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515510:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.515513:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.515517:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515523:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cd88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.515540:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001aacf1e9 reply state 000000004c4b9195 transno 8589950980 ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.515548:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580317.515584:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5200/0xcb2b2f2f7e4cd81 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec9c expref: 95 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515599:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cda4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec9c expref: 94 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.515606:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:3.0:1777580317.515608:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.515611:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030a00, rc 0) 00000100:00100000:3.0:1777580317.515663:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283430:x1863919946764800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4611us (54540us total) trans 8589950980 rc 0/0 00000100:00100000:3.0:1777580317.515672:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19811 00000100:00100000:3.0:1777580317.515679:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838459977961 time 7838462982855 state 0x2 ref 0 00010000:00010000:1.0:1777580317.517106:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.517124:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.517167:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.517274:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.517288:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.517321:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.517330:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4ccee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.517363:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.517367:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.517370:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.517392:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.517837:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917494784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 107454us (110741us total) trans 8589939078 rc 0/0 00000100:00100000:0.0:1777580317.517850:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12118 00000004:00080000:0.0:1777580317.517933:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e7800/2, rc 0, transno 8589939078 00000100:00100000:0.0:1777580317.517961:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917494784:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.517969:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e4700/2, rc 0, transno 8589939077 00000100:00100000:1.0:1777580317.517978:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917494912:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580317.518029:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023985f9c00/2, rc 0, transno 8589939075 00000100:00100000:1.0:1777580317.518050:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023985f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917493632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580317.518108:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3289:x1863919917494400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 112833us (113845us total) trans 8589938676 rc 0/0 00000100:00100000:1.0:1777580317.518130:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12114 00000004:00080000:1.0:1777580317.519022:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02395cf9500/2, rc 0, transno 8589938676 00000100:00100000:1.0:1777580317.519033:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02395cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917494400:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580317.520445:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.520452:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.520464:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580317.530288:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.530326:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.530349:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.530373:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.530399:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.530518:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.530557:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02383e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917498112:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580317.530560:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.530600:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530660:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530669:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530676:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.530681:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530691:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530712:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:1.0:1777580317.530724:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.530731:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530738:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cd96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530800:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530807:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530813:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530817:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.530820:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530826:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530835:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024997a0300) 00010000:00010000:1.0:1777580317.530837:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.530841:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.530846:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cd8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.530885:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946765824 00000100:00100000:1.0:1777580317.530901:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946765824 00000100:00100000:1.0:1777580317.530942:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838459977961 time 7838462982855 state 0x0 ref 1 00000100:00100000:1.0:1777580317.530955:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838463082855 time 7838462982855 state 0x1 ref 1 00000100:00100000:1.0:1777580317.530974:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766080 00000100:00100000:1.0:1777580317.530977:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766080 00000100:00100000:1.0:1777580317.530989:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838463082855 time 7838462982855 state 0x1 ref 2 00000100:00100000:1.0:1777580317.531001:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766336 00000100:00100000:1.0:1777580317.531003:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766336 00000100:00100000:1.0:1777580317.531013:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838463082855 time 7838462982855 state 0x1 ref 3 00000100:00100000:1.0:1777580317.531024:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766592 00000100:00100000:1.0:1777580317.531026:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766592 00000100:00100000:1.0:1777580317.531034:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838463082855 time 7838462982855 state 0x1 ref 4 00000100:00100000:1.0:1777580317.531051:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838480014157 time 7838479914157 state 0x1 ref 4 00000100:00100000:1.0:1777580317.531064:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283427:x1863919946765824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.531101:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.531163:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4cdb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecaa expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.531237:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4cdb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecaa expref: 96 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.531251:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4cdb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecaa expref: 96 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.531288:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:1.0:1777580317.531291:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.531294:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd600, rc 0) 00000100:00100000:1.0:1777580317.531370:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:283427:x1863919946765824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 307us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.531379:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19813 00000100:00100000:1.0:1777580317.531406:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838480369178 time 7838480269178 state 0x1 ref 3 00000100:00100000:1.0:1777580317.531415:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283430:x1863919946766080:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.531469:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.531491:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cda4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec9c expref: 95 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.531511:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:1.0:1777580317.531522:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580317.532100:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838481060478 time 7838480960478 state 0x1 ref 3 00000100:00100000:3.0:1777580317.532118:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283442:x1863919946766336:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580317.532204:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580317.532223:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cd73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec95 expref: 310 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.532240:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580317.532243:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.534651:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.534651:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.534689:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.534694:0:207396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 94 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.534709:0:207396:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.534709:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.534848:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838481060478 time 7838483706216 state 0x0 ref 3 00000100:00100000:0.0:1777580317.534874:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+95:283431:x1863919946766592:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.534898:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.534914:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4cdc7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecb1 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.534925:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000eb979c9a reply state 000000001eddbf64 transno 8589950981 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.534958:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.535085:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+97:283430:x1863919946766080:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3669us (4757us total) trans 8589950981 rc 0/0 00010000:00010000:0.0:1777580317.535086:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.535101:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19814 00010000:00010000:0.0:1777580317.535104:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535115:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535130:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535160:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535182:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.535196:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766720 00000100:00100000:1.0:1777580317.535206:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766720 00010000:00010000:1.0:1777580317.535240:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 16 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.535282:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4484 00000100:00100000:1.0:1777580317.535291:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2361:x1863919946766720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580317.535305:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.535311:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 16 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.535327:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 16 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.535351:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001087254e/0xcb2b2f2f7e4c3b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea81 expref: 16 pid: 205900 timeout: 7938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.535355:0:207396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 96 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.535374:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.535376:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.535381:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.535468:0:207396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 96 pid: 187630 timeout: 7938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.535487:0:207396:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02383e5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:207396:1863919917498240:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580317.535565:0:207396:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024811ca9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1777580317.535792:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d0:0x0], index 1: 0 00010000:00010000:0.0:1777580317.535968:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4cddc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535979:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4cddc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.535988:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4cddc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536030:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536037:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536045:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536051:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.536056:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536063:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536074:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.536077:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.536157:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536164:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4cdce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.536180:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f0499b7e reply state 00000000a35a8844 transno 8589950982 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.536187:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.536218:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4cdc7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb1 expref: 98 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536232:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4cddc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb1 expref: 97 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.536240:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:0.0:1777580317.536242:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.536245:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9bc00, rc 0) 00000100:00100000:0.0:1777580317.536287:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283431:x1863919946766592:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1424us (5913us total) trans 8589950982 rc 0/0 00000100:00100000:0.0:1777580317.536296:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19816 00000100:00100000:0.0:1777580317.536337:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766848 00000100:00100000:0.0:1777580317.536343:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766848 00000100:00100000:0.0:1777580317.536387:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12129 00000100:00100000:0.0:1777580317.536399:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2361:x1863919946766848:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580317.536675:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2361:x1863919946766848:12345-192.168.202.9@tcp:2:touch.500 Request processed in 279us (6156us total) trans 8589939079 rc 0/0 00000100:00100000:0.0:1777580317.536684:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12129 00010000:00010000:1.0:1777580317.537359:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.537417:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.537705:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946766720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 2412us (7301us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.537717:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4484 00010000:00010000:3.0:1777580317.540343:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540379:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540388:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540395:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.540401:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540409:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540432:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa02487fb4100) 00010000:00010000:3.0:1777580317.540436:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.540442:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540448:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cdc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540503:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540516:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540525:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540543:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.540568:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580317.540984:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917497984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46877us (50516us total) trans 8589939080 rc 0/0 00000100:00100000:3.0:1777580317.540997:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12128 00010000:00010000:3.0:1777580317.541040:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580317.541047:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.541056:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249f0b5800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580317.541060:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.541068:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.541084:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.541092:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a241dc25/0xcb2b2f2f7e4cd57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.541117:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.541127:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.541129:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777580317.541256:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0239667c700/2, rc 0, transno 8589939080 00000100:00100000:3.0:1777580317.541273:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917497984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580317.551578:0:207396:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02383e5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:207396:1863919917498240:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580317.551623:0:207396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.554359:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.554715:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.554747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.556377:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946767616 00000100:00100000:0.0:1777580317.556397:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946767616 00010000:00010000:0.0:1777580317.556465:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 97 pid: 187630 timeout: 7938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.556518:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4485 00000100:00100000:0.0:1777580317.556529:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+97:2362:x1863919946767616:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580317.556549:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.556556:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 97 pid: 187630 timeout: 7938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.556572:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 97 pid: 187630 timeout: 7938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.556602:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4c959 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebed expref: 97 pid: 187630 timeout: 7938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.556604:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.556633:0:187616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580317.556639:0:187616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.556650:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.556660:0:187616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.556696:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.556699:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580317.556734:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.556768:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+96:2362:x1863919946767616:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 239us (2017us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580317.556893:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556903:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556909:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556916:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.556921:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556929:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556967:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0248a60ea00) 00010000:00010000:1.0:1777580317.556971:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.556976:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.556983:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4cdd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.557026:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946767232 00000100:00100000:1.0:1777580317.557032:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946767232 00000100:00100000:1.0:1777580317.557069:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838483806216 time 7838483706216 state 0x1 ref 2 00000100:00100000:1.0:1777580317.557091:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946767488 00000100:00100000:1.0:1777580317.557095:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946767488 00000100:00100000:1.0:1777580317.557109:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838483806216 time 7838483706216 state 0x1 ref 3 00000100:00100000:1.0:1777580317.557122:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946767744 00000100:00100000:1.0:1777580317.557125:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946767744 00000100:00100000:1.0:1777580317.557160:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838483806216 time 7838483706216 state 0x1 ref 4 00000100:00100000:1.0:1777580317.557180:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838506142275 time 7838506042275 state 0x1 ref 4 00000100:00100000:1.0:1777580317.557190:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283431:x1863919946767232:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.557255:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.557268:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4cddc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb1 expref: 98 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.557279:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:1.0:1777580317.557286:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.557386:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.557398:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.557413:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.558322:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d230860c reply state 00000000a8519246 transno 8589950983 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.558338:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.558713:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4485 00000100:00100000:0.0:1777580317.558797:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838507743412 time 7838507643412 state 0x1 ref 4 00000100:00100000:0.0:1777580317.558816:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283432:x1863919946767488:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.558835:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.558853:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4cdf1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecb8 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559737:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559761:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559774:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559802:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559809:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.559816:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.559850:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+99:283431:x1863919946767232:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2657us (5502us total) trans 8589950983 rc 0/0 00000100:00100000:1.0:1777580317.559862:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19817 00000100:00100000:1.0:1777580317.559902:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838507743412 time 7838508764771 state 0x0 ref 3 00000100:00100000:1.0:1777580317.559920:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+98:283430:x1863919946767744:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.559939:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.559956:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc800/0xcb2b2f2f7e4ce06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecbf expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.559999:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc800/0xcb2b2f2f7e4ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecbf expref: 99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.560012:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc800/0xcb2b2f2f7e4ce06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecbf expref: 99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.560033:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa02481358500) 00010000:00010000:1.0:1777580317.560085:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.560090:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc800, rc 0) 00000100:00100000:1.0:1777580317.560127:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+99:283430:x1863919946767744:12345-192.168.202.9@tcp:101:touch.500 Request processed in 213us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.560168:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19819 00000100:00100000:3.0:1777580317.560179:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768000 00000100:00100000:3.0:1777580317.560191:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768000 00000100:00100000:1.0:1777580317.560217:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946766976 00000100:00100000:1.0:1777580317.560223:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946766976 00000100:00100000:3.0:1777580317.560252:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4243 00000100:00100000:3.0:1777580317.560263:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+99:283428:x1863919946768000:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580317.560270:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12130 00000100:00100000:1.0:1777580317.560279:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2362:x1863919946766976:12345-192.168.202.9@tcp:2:touch.500 00000004:00080000:0.0:1777580317.560647:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f5:0x0], index 0: 0 00010000:00010000:0.0:1777580317.560857:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3400/0xcb2b2f2f7e4ce0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.560883:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3400/0xcb2b2f2f7e4ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.560894:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3400/0xcb2b2f2f7e4ce0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.560991:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2362:x1863919946766976:12345-192.168.202.9@tcp:2:touch.500 Request processed in 712us (6208us total) trans 8589938680 rc 0/0 00000100:00100000:1.0:1777580317.561000:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12130 00010000:00010000:0.0:1777580317.561025:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561035:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561042:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561048:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024813e3000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.561053:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561061:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561073:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.561075:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.561080:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561086:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cdf8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.561106:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000006082baf reply state 00000000b9d1e66c transno 8589950984 ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.561124:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.561368:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4cdf1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb8 expref: 101 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561386:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3400/0xcb2b2f2f7e4ce0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb8 expref: 100 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.561394:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580317.561396:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.561399:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024813e3400, rc 0) 00000100:00100000:0.0:1777580317.561436:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283432:x1863919946767488:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2628us (6722us total) trans 8589950984 rc 0/0 00000100:00100000:0.0:1777580317.561443:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19818 00000100:00100000:3.0:1777580317.562455:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283428:x1863919946768000:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2188us (5714us total) trans 8589950985 rc 0/0 00000100:00100000:3.0:1777580317.562468:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4243 00010000:00010000:2.0:1777580317.563042:0:207396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.563058:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580317.563789:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007bf42d40 reply state 0000000082c76412 transno 8589950986 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.563941:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580317.564083:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+311:283442:x1863919946766336:12345-192.168.202.9@tcp:36:touch.500 Request processed in 31966us (33728us total) trans 8589950986 rc 0/0 00000100:00100000:2.0:1777580317.564357:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19815 00000100:00100000:2.0:1777580317.564367:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838507743412 time 7838508764771 state 0x2 ref 0 00010000:00010000:3.0:1777580317.575200:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575222:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575230:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575237:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.575244:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575253:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575281:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa02481358000) 00010000:00010000:3.0:1777580317.575285:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.575290:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.575297:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4cdea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.589830:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.589889:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.590287:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590304:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590312:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590319:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.590326:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590334:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590357:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:3.0:1777580317.590372:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.590380:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.590387:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4cdb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.593934:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.593992:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.594024:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.594060:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.594309:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.594335:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.599954:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.599990:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.612028:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768128 00000100:00100000:0.0:1777580317.612048:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768128 00000100:00100000:0.0:1777580317.612401:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838507743412 time 7838508764771 state 0x0 ref 1 00000100:00100000:0.0:1777580317.612418:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838508864771 time 7838508764771 state 0x1 ref 1 00000100:00100000:0.0:1777580317.612451:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768384 00000100:00100000:0.0:1777580317.612456:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768384 00000100:00100000:0.0:1777580317.612471:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838073356841 time 7838289248216 state 0x0 ref 1 00000100:00100000:0.0:1777580317.612478:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 1 00000100:00100000:0.0:1777580317.612485:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768512 00000100:00100000:0.0:1777580317.612487:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768512 00000100:00100000:0.0:1777580317.612509:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 2 00000100:00100000:0.0:1777580317.612530:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768640 00000100:00100000:0.0:1777580317.612533:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768640 00000100:00100000:0.0:1777580317.612548:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 3 00000100:00100000:0.0:1777580317.612555:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768768 00000100:00100000:0.0:1777580317.612557:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768768 00000100:00100000:0.0:1777580317.613344:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 4 00000100:00100000:0.0:1777580317.613362:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768896 00000100:00100000:0.0:1777580317.613367:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768896 00000100:00100000:0.0:1777580317.613379:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 5 00000100:00100000:0.0:1777580317.613387:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769408 00000100:00100000:0.0:1777580317.613390:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769408 00000100:00100000:0.0:1777580317.613400:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838508864771 time 7838508764771 state 0x1 ref 2 00000100:00100000:0.0:1777580317.613407:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769536 00000100:00100000:0.0:1777580317.613409:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769536 00000100:00100000:0.0:1777580317.613419:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838289348216 time 7838289248216 state 0x1 ref 6 00000100:00100000:0.0:1777580317.613433:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838562395973 time 7838562295973 state 0x1 ref 6 00000100:00100000:0.0:1777580317.613451:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283435:x1863919946768384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.613490:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1777580317.613520:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769152 00000100:00100000:3.0:1777580317.613527:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769152 00010000:00010000:0.0:1777580317.613531:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4ce1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eccd expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.613561:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4244 00000100:00100000:3.0:1777580317.613568:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283427:x1863919946769152:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:0.0:1777580317.613723:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613741:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613762:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613779:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613800:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613808:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613931:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613940:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.613947:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.614452:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x834:0x0]: returning size 0 00000004:00200000:0.0:1777580317.614458:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.614485:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616739:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616769:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616923:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616931:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616938:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.616944:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616953:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616973:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.616976:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.616983:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.616989:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4ce22 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617020:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617026:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617032:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617037:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.617048:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617055:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617063:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0248a60e300) 00010000:00010000:0.0:1777580317.617065:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.617068:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617074:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4ce29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617169:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4ce1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eccd expref: 110 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617189:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eccd expref: 109 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.617197:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0241785f800) 00010000:00010000:0.0:1777580317.617199:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.617202:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b000, rc 0) 00000100:00100000:0.0:1777580317.617308:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283435:x1863919946768384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3862us (27416us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.617319:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19821 00000100:00100000:0.0:1777580317.617378:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838566336168 time 7838566236168 state 0x1 ref 2 00000100:00100000:0.0:1777580317.617396:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283431:x1863919946768128:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.617427:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.617452:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4ce37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecc6 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.617888:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838566847640 time 7838566747640 state 0x1 ref 5 00000100:00100000:1.0:1777580317.617909:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283437:x1863919946768512:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.617920:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.617935:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4ce3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecd4 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618016:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618033:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618046:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618074:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618081:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618088:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618248:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4ce37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecc6 expref: 110 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618263:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4ce37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecc6 expref: 110 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618269:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618280:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618285:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:0.0:1777580317.618288:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.618289:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618292:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb2800, rc 0) 00000004:00200000:1.0:1777580317.618325:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x836:0x0]: returning size 0 00000004:00200000:1.0:1777580317.618330:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1777580317.618346:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024975b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283431:x1863919946768128:12345-192.168.202.9@tcp:101:touch.500 Request processed in 956us (28532us total) trans 0 rc 0/0 00000004:00010000:1.0:1777580317.618354:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.618357:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19820 00010000:00010000:1.0:1777580317.618370:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618377:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618383:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.618392:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838566336168 time 7838567253011 state 0x0 ref 1 00010000:00010000:1.0:1777580317.618405:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.618409:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283432:x1863919946769408:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580317.618420:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbdc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.618438:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618445:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618449:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580317.618455:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.618460:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.618464:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618469:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3400/0xcb2b2f2f7e4ce0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecb8 expref: 109 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618474:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4ce45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618494:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.618494:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:1.0:1777580317.618501:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618506:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618511:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.618514:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618529:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618537:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02481358b00) 00010000:00010000:1.0:1777580317.618540:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.618542:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618559:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4ce4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618590:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4ce3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecd4 expref: 109 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618603:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecd4 expref: 108 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618611:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa0249f048000) 00010000:00010000:1.0:1777580317.618613:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.618615:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd400, rc 0) 00000100:00100000:1.0:1777580317.618642:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283437:x1863919946768512:12345-192.168.202.9@tcp:101:rm.500 Request processed in 740us (24724us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.618649:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19822 00000100:00100000:1.0:1777580317.618682:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838567645036 time 7838567545036 state 0x1 ref 4 00000100:00100000:1.0:1777580317.618693:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283436:x1863919946768640:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.618702:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.618718:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4ce5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecdb expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618752:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618761:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618768:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618788:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618795:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618801:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618864:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618873:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618880:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.618901:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x835:0x0]: returning size 0 00000004:00200000:1.0:1777580317.618904:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.618915:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618930:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618938:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618943:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618949:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618954:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.618957:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618962:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618969:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.618972:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.618975:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618979:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4ce61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618990:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.618995:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619007:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619011:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.619014:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619019:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619027:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02481358900) 00010000:00010000:1.0:1777580317.619029:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.619031:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619037:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4ce68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619064:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4ce5a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecdb expref: 109 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619076:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecdb expref: 108 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619084:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0241785f300) 00010000:00010000:1.0:1777580317.619087:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.619089:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd800, rc 0) 00000100:00100000:1.0:1777580317.619115:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283436:x1863919946768640:12345-192.168.202.9@tcp:101:rm.500 Request processed in 423us (25125us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.619130:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19823 00000100:00100000:1.0:1777580317.619199:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838568161308 time 7838568061308 state 0x1 ref 3 00000100:00100000:1.0:1777580317.619211:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283441:x1863919946768768:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.619220:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.619232:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4ce76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ece2 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.619235:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.619288:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619297:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619305:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619318:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619324:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.619327:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619331:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.619348:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.619357:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619395:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619405:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619422:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.619445:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x839:0x0]: returning size 0 00000004:00200000:1.0:1777580317.619448:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.619461:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619469:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619477:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619483:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619489:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619495:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.619498:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619505:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619513:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.619515:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.619518:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619535:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4ce7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619545:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619551:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619557:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619562:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.619565:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619571:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619578:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02481358f00) 00010000:00010000:1.0:1777580317.619581:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.619583:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619589:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4ce84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619624:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4ce76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece2 expref: 110 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619649:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece2 expref: 109 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.619657:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580317.619659:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580317.619662:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbca00, rc 0) 00000100:00100000:1.0:1777580317.619691:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283441:x1863919946768768:12345-192.168.202.9@tcp:101:rm.500 Request processed in 482us (25668us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.619698:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19824 00000100:00100000:3.0:1777580317.620400:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.620488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00010000:0.0:1777580317.620735:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000de5a7435 reply state 000000001a6de980 transno 8589950987 ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.620748:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580317.620959:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283427:x1863919946769152:12345-192.168.202.9@tcp:35:touch.500 Request processed in 7390us (26649us total) trans 8589950988 rc 0/0 00000100:00100000:0.0:1777580317.620964:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283432:x1863919946769408:12345-192.168.202.9@tcp:36:touch.500 Request processed in 2560us (26628us total) trans 8589950987 rc 0/0 00000100:00100000:3.0:1777580317.620971:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4244 00000100:00100000:0.0:1777580317.620971:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19826 00000100:00100000:0.0:1777580317.620978:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838566336168 time 7838567253011 state 0x2 ref 0 00000100:00100000:0.0:1777580317.621002:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769664 00000100:00100000:0.0:1777580317.621011:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769664 00000100:00100000:0.0:1777580317.621042:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838568161308 time 7838568061308 state 0x1 ref 3 00000100:00100000:0.0:1777580317.621051:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769920 00000100:00100000:0.0:1777580317.621053:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769920 00000100:00100000:0.0:1777580317.621064:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838566336168 time 7838567253011 state 0x0 ref 1 00000100:00100000:0.0:1777580317.621072:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838567353011 time 7838567253011 state 0x1 ref 1 00000100:00100000:0.0:1777580317.621084:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838567353011 time 7838569947509 state 0x0 ref 1 00000100:00100000:1.0:1777580317.621235:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570196387 time 7838570096387 state 0x1 ref 3 00000100:00100000:1.0:1777580317.621253:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283443:x1863919946768896:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.621271:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.621290:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4ce99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ece9 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.621298:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7838570247072 time 7838570147072 state 0x1 ref 3 00000100:00100000:3.0:1777580317.621315:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283438:x1863919946769536:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.621325:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.621336:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4cea0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecf0 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621360:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621376:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621387:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621404:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621431:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621438:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621476:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621486:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621495:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621506:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621525:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621532:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621819:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621829:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621835:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580317.621863:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x837:0x0]: returning size 0 00000004:00200000:3.0:1777580317.621868:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580317.621887:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621898:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621906:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621912:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621918:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621935:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.621939:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621948:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621961:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.621964:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.621969:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621969:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621986:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4ceb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621990:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.621997:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.621999:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622010:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622017:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622022:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.622024:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622030:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580317.622030:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83a:0x0]: returning size 0 00000004:00200000:1.0:1777580317.622037:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580317.622049:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622053:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024997a0f00) 00010000:00010000:3.0:1777580317.622059:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.622062:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622062:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622079:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4cebc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622083:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622090:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622097:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622116:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.622118:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ce00/0xcb2b2f2f7e4cea0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf0 expref: 112 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622120:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622161:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf0 expref: 111 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622169:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa02486090900) 00010000:00010000:3.0:1777580317.622172:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.622175:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024813e3000, rc 0) 00000100:00100000:3.0:1777580317.622232:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283438:x1863919946769536:12345-192.168.202.9@tcp:101:rm.500 Request processed in 921us (22240us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.622240:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19827 00000100:00100000:3.0:1777580317.622272:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570247072 time 7838571134355 state 0x0 ref 2 00000100:00100000:3.0:1777580317.622300:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283439:x1863919946769664:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.622311:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.622322:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4ced1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecf7 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622384:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622393:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622401:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622413:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622420:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622426:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622478:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622480:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622492:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622497:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.622501:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.622502:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622505:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622519:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cea7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580317.622528:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x838:0x0]: returning size 0 00000004:00200000:3.0:1777580317.622532:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1777580317.622533:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622541:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.622543:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622554:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622563:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.622568:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622576:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622576:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622593:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622598:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622615:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622620:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02481358400) 00010000:00010000:3.0:1777580317.622622:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.622626:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.622627:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622631:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622638:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622644:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ceae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622651:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.622655:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.622659:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622664:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4ced8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622679:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622682:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4ce99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece9 expref: 112 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622688:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622701:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622702:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece9 expref: 111 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622714:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.622719:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622721:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa0249f66ff00) 00010000:00010000:1.0:1777580317.622727:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.622732:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.622732:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b800, rc 0) 00010000:00010000:3.0:1777580317.622743:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024997a0b00) 00010000:00010000:3.0:1777580317.622746:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.622749:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622754:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cedf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622793:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3e00/0xcb2b2f2f7e4ced1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf7 expref: 112 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622807:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf7 expref: 111 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.622813:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024997a0c00) 00010000:00010000:3.0:1777580317.622816:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.622818:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02480030e00, rc 0) 00000100:00100000:3.0:1777580317.622845:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283439:x1863919946769664:12345-192.168.202.9@tcp:101:rm.500 Request processed in 563us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.622890:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19828 00000100:00100000:1.0:1777580317.623179:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023850c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283443:x1863919946768896:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1930us (29119us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.623403:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19825 00000100:00100000:1.0:1777580317.623410:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570247072 time 7838571134355 state 0x2 ref 0 00010000:00010000:1.0:1777580317.623456:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623465:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623471:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623486:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024813e2000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.623489:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623495:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623505:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0248a60e500) 00010000:00010000:1.0:1777580317.623508:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.623512:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.623517:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e2000/0xcb2b2f2f7e4cdff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.623592:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946768256 00000100:00100000:1.0:1777580317.623602:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946768256 00000100:00100000:1.0:1777580317.623678:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12131 00000100:00100000:1.0:1777580317.623689:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2364:x1863919946768256:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580317.623704:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+310:283442:x1863919946769920:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.623724:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.623752:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e800/0xcb2b2f2f7e4ceed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed05 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.623817:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e800/0xcb2b2f2f7e4ceed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed05 expref: 311 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.623829:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e800/0xcb2b2f2f7e4ceed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed05 expref: 311 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.623847:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580317.623850:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580317.623853:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4e800, rc 0) 00000100:00100000:0.0:1777580317.623891:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+311:283442:x1863919946769920:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2797us (3402us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.623897:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19829 00000100:00100000:0.0:1777580317.623902:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838567353011 time 7838569947509 state 0x2 ref 0 00000100:00100000:1.0:1777580317.626923:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2364:x1863919946768256:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3221us (26968us total) trans 8589939081 rc 0/0 00000100:00100000:1.0:1777580317.626940:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12131 00000100:00100000:3.0:1777580317.627175:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.627397:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770048 00000100:00100000:1.0:1777580317.627409:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770048 00000100:00100000:1.0:1777580317.627458:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12132 00000100:00100000:1.0:1777580317.627468:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2363:x1863919946770048:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.627489:0:205906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.627530:0:205906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed0c expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580317.627562:0:205906:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ef:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:1.0:1777580317.627587:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.627589:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.627599:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 18 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.627619:0:205906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 18 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.627635:0:205906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b200, rc 0) 00000100:00100000:1.0:1777580317.627667:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2363:x1863919946770048:12345-192.168.202.9@tcp:101:rm.500 Request processed in 201us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.627674:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12132 00000100:00100000:3.0:1777580317.632957:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.632994:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.633029:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946769792 00000100:00100000:3.0:1777580317.633042:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946769792 00000100:00100000:3.0:1777580317.633097:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570247072 time 7838571134355 state 0x0 ref 1 00000100:00100000:3.0:1777580317.633113:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838571234355 time 7838571134355 state 0x1 ref 1 00000100:00100000:2.0:1777580317.633550:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770304 00000100:00100000:2.0:1777580317.633557:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770304 00000100:00100000:2.0:1777580317.634266:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12133 00000100:00100000:2.0:1777580317.634294:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2362:x1863919946770304:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580317.634930:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2362:x1863919946770304:12345-192.168.202.9@tcp:2:touch.500 Request processed in 634us (1984us total) trans 8589938681 rc 0/0 00000100:00100000:2.0:1777580317.634939:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12133 00000100:00100000:3.0:1777580317.640809:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.640965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.640985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.641018:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770432 00000100:00100000:0.0:1777580317.641033:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770432 00000100:00100000:3.0:1777580317.641064:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.641092:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770176 00000100:00100000:3.0:1777580317.641096:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770176 00000100:00100000:3.0:1777580317.641121:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770560 00000100:00100000:3.0:1777580317.641123:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770560 00000100:00100000:3.0:1777580317.641169:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12134 00000100:00100000:3.0:1777580317.641182:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946770432:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.641207:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1777580317.641223:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12135 00000100:00100000:2.0:1777580317.641233:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2364:x1863919946770176:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580317.641241:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580317.641264:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed13 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.641265:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed1a expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580317.641301:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15cd:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00002000:00010000:2.0:1777580317.641301:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f0:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580317.641325:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.641325:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.641327:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.641327:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.641338:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 21 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.641338:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 19 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.641359:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 19 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.641374:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fe00, rc 0) 00000100:00100000:2.0:1777580317.641451:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2364:x1863919946770176:12345-192.168.202.9@tcp:101:rm.500 Request processed in 220us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.641457:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12135 00000100:00100000:2.0:1777580317.641481:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12136 00000100:00100000:2.0:1777580317.641487:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2361:x1863919946770560:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580317.641516:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580317.641553:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed21 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580317.641697:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15cb:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:2.0:1777580317.641707:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.641709:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580317.641714:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 22 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.641727:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 22 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.641737:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0238997fa00, rc 0) 00000100:00100000:2.0:1777580317.641769:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2361:x1863919946770560:12345-192.168.202.9@tcp:101:rm.500 Request processed in 282us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.641774:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12136 00010000:00010000:3.0:1777580317.642546:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 22 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.642564:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0249f0b5200, rc 0) 00000100:00100000:3.0:1777580317.642614:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2362:x1863919946770432:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1434us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.642623:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12134 00000100:00100000:1.0:1777580317.642762:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770688 00000100:00100000:1.0:1777580317.642772:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770688 00000100:00100000:1.0:1777580317.642829:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838567353011 time 7838569947509 state 0x0 ref 1 00000100:00100000:1.0:1777580317.642843:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570047509 time 7838569947509 state 0x1 ref 1 00000100:00100000:1.0:1777580317.642872:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570047509 time 7838591733341 state 0x0 ref 1 00000100:00100000:1.0:1777580317.642885:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283432:x1863919946770688:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.642902:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.642925:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4cf10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed28 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643708:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4cf10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x840:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed28 expref: 111 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.643724:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838571234355 time 7838592584294 state 0x0 ref 1 00010000:00010000:1.0:1777580317.643733:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4cf10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x840:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed28 expref: 111 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.643745:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283444:x1863919946769792:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.643765:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:1.0:1777580317.643769:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.643774:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:1.0:1777580317.643854:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283432:x1863919946770688:12345-192.168.202.9@tcp:101:touch.500 Request processed in 973us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.643863:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19831 00000100:00100000:1.0:1777580317.643869:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570047509 time 7838591733341 state 0x2 ref 0 00010000:00010000:1.0:1777580317.643918:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643929:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643936:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643943:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.643948:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643956:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643981:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:1.0:1777580317.643983:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.643987:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.643994:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4ce8b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644190:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.644209:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e4cf17 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ecfe expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644847:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644864:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644876:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644896:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644903:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.644921:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645073:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645081:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645089:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580317.645122:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83b:0x0]: returning size 0 00000004:00200000:3.0:1777580317.645127:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580317.645177:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645191:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645200:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645206:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645212:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645218:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480031c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.645220:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645235:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645245:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.645247:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.645251:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645256:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031c00/0xcb2b2f2f7e4cf1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645271:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645276:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.645281:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.648351:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02480030a00 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:2.0:1777580317.648518:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.648582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.648679:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580317.650633:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.650658:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.650679:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024997a0d00) 00010000:00010000:3.0:1777580317.650682:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.650689:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.650722:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030a00/0xcb2b2f2f7e4cf25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.654109:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b4c00/0xcb2b2f2f7e4cf17 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecfe expref: 111 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.654161:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecfe expref: 110 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.654172:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:3.0:1777580317.654175:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580317.654180:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4d200, rc 0) 00000100:00100000:3.0:1777580317.654432:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283444:x1863919946769792:12345-192.168.202.9@tcp:101:rm.500 Request processed in 10693us (21434us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.654443:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19830 00000100:00100000:3.0:1777580317.654453:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838571234355 time 7838592584294 state 0x2 ref 0 00000100:00100000:2.0:1777580317.655068:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.660358:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770816 00000100:00100000:1.0:1777580317.660376:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770816 00000100:00100000:1.0:1777580317.660464:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946770944 00000100:00100000:1.0:1777580317.660467:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946770944 00000100:00100000:1.0:1777580317.660482:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771200 00000100:00100000:1.0:1777580317.660484:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771200 00000100:00100000:1.0:1777580317.660527:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12137 00000100:00100000:1.0:1777580317.660539:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946770816:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.666443:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.666497:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed2f expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580317.666546:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f1:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:1.0:1777580317.666591:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.666594:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.666610:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.666632:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.666675:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8be00, rc 0) 00000100:00100000:1.0:1777580317.666776:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2362:x1863919946770816:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6237us (18277us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.666798:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12137 00000100:00100000:1.0:1777580317.666854:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12138 00000100:00100000:1.0:1777580317.666869:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946770944:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.666883:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.666893:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed36 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580317.666907:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f2:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:1.0:1777580317.666917:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.666919:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.666923:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.666934:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.666942:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ac00, rc 0) 00000100:00100000:1.0:1777580317.666964:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2362:x1863919946770944:12345-192.168.202.9@tcp:101:rm.500 Request processed in 103us (18382us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.666970:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12138 00000100:00100000:1.0:1777580317.666983:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12139 00000100:00100000:1.0:1777580317.666999:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2361:x1863919946771200:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.667008:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.667022:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed3d expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580317.667040:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15cc:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:1.0:1777580317.667050:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.667051:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580317.667056:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 22 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.667068:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 22 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.667076:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8bc00, rc 0) 00000100:00100000:1.0:1777580317.667111:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2361:x1863919946771200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 114us (18432us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.667118:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12139 00000100:00100000:2.0:1777580317.672319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.672455:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771072 00000100:00100000:1.0:1777580317.672469:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771072 00000100:00100000:1.0:1777580317.672550:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12140 00000100:00100000:1.0:1777580317.672572:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2364:x1863919946771072:12345-192.168.202.9@tcp:2:touch.500 00002000:00010000:1.0:1777580317.673400:0:188247:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x240000400:0x15ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777580317.673406:0:188247:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x240000400:0x15ec:0x0] updating lvb mtime from disk: 1777580315 -> 1777580316 00002000:00010000:1.0:1777580317.673409:0:188247:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x240000400:0x15ec:0x0] updating lvb atime from disk: 1777580315 -> 1777580316 00002000:00010000:1.0:1777580317.673411:0:188247:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x15ec:0x0] updating lvb ctime from disk: 1777580315 -> 1777580316 00002000:00010000:1.0:1777580317.673434:0:188247:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x240000400:0x15ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1777580317.681388:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2364:x1863919946771072:12345-192.168.202.9@tcp:2:touch.500 Request processed in 8810us (26304us total) trans 8589939082 rc 0/0 00000100:00100000:1.0:1777580317.681409:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12140 00000100:00100000:1.0:1777580317.684206:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771456 00000100:00100000:1.0:1777580317.684229:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771456 00000100:00100000:1.0:1777580317.684318:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4245 00000100:00100000:1.0:1777580317.684330:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283430:x1863919946771456:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580317.694280:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.694333:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.694357:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.694393:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580317.694430:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946772096 00000100:00100000:2.0:1777580317.694461:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946772096 00000100:00100000:2.0:1777580317.694530:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838571234355 time 7838592584294 state 0x0 ref 1 00000100:00100000:2.0:1777580317.694545:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838592684294 time 7838592584294 state 0x1 ref 1 00000100:00100000:2.0:1777580317.697755:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838592684294 time 7838646605319 state 0x0 ref 1 00000100:00100000:2.0:1777580317.697812:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283413:x1863919946772096:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580317.697841:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580317.697868:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4cf48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed4b expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.697959:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.697978:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.697991:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698010:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698016:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698023:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698172:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698197:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698204:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580317.698239:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x82e:0x0]: returning size 0 00000004:00200000:2.0:1777580317.698244:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580317.698266:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698277:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698287:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698293:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698300:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698306:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0238997ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.698311:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698320:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698333:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580317.698345:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.698351:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698357:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997ee00/0xcb2b2f2f7e4cf4f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698373:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698379:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698385:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698390:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580317.698392:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698398:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698404:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02493bbd000) 00010000:00010000:2.0:1777580317.698406:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580317.698408:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698413:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021000/0xcb2b2f2f7e4cf56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698447:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f600/0xcb2b2f2f7e4cf48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed4b expref: 114 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698466:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed4b expref: 113 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580317.698473:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:2.0:1777580317.698475:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580317.698477:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389021200, rc 0) 00000100:00100000:2.0:1777580317.700465:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283413:x1863919946772096:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2671us (6055us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580317.700481:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19832 00000100:00100000:2.0:1777580317.700491:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838592684294 time 7838646605319 state 0x2 ref 0 00000100:00100000:3.0:1777580317.701060:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771712 00000100:00100000:3.0:1777580317.701073:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771712 00000100:00100000:3.0:1777580317.701123:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4246 00000100:00100000:3.0:1777580317.701336:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283431:x1863919946771712:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580317.707591:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283430:x1863919946771456:12345-192.168.202.9@tcp:35:touch.500 Request processed in 23241us (35265us total) trans 8589950989 rc 0/0 00000100:00100000:1.0:1777580317.707612:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4245 00000100:00100000:1.0:1777580317.707698:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771840 00000100:00100000:1.0:1777580317.707711:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771840 00000100:00100000:1.0:1777580317.707772:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946771968 00000100:00100000:1.0:1777580317.707776:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946771968 00000100:00100000:1.0:1777580317.707814:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12141 00000100:00100000:1.0:1777580317.707823:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2361:x1863919946771840:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580317.708053:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283431:x1863919946771712:12345-192.168.202.9@tcp:35:touch.500 Request processed in 6919us (13789us total) trans 8589950990 rc 0/0 00000100:00100000:3.0:1777580317.708062:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4246 00000100:00100000:3.0:1777580317.708095:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12142 00000100:00100000:3.0:1777580317.708105:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2361:x1863919946771968:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580317.708129:0:205895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580317.708209:0:205895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed44 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580317.708242:0:205895:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15ce:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580317.708264:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.708266:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580317.708295:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 23 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.708316:0:205895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 23 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.708331:0:205895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ce00, rc 0) 00000100:00100000:1.0:1777580317.708487:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2361:x1863919946771840:12345-192.168.202.9@tcp:2:touch.500 Request processed in 664us (14152us total) trans 8589939083 rc 0/0 00000100:00100000:1.0:1777580317.708505:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12141 00000100:00100000:3.0:1777580317.708670:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946771968:12345-192.168.202.9@tcp:101:rm.500 Request processed in 568us (14312us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580317.708677:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12142 00000100:00100000:3.0:1777580317.732445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.732483:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946772608 00000100:00100000:1.0:1777580317.732498:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946772608 00000100:00100000:3.0:1777580317.732501:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.732573:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4247 00000100:00100000:1.0:1777580317.732587:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+311:283442:x1863919946772608:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580317.732716:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.732738:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946772864 00000100:00100000:3.0:1777580317.732742:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946772864 00000100:00100000:3.0:1777580317.732765:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4248 00000100:00100000:3.0:1777580317.732771:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283432:x1863919946772864:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580317.733256:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283432:x1863919946772864:12345-192.168.202.9@tcp:35:touch.500 Request processed in 482us (537us total) trans 8589950991 rc 0/0 00000100:00100000:3.0:1777580317.734958:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4248 00000100:00100000:1.0:1777580317.737069:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283442:x1863919946772608:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4467us (4621us total) trans 8589950992 rc 0/0 00000100:00100000:1.0:1777580317.738921:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4247 00000100:00100000:1.0:1777580317.738989:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946772352 00000100:00100000:1.0:1777580317.739001:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946772352 00000100:00100000:1.0:1777580317.739047:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838592684294 time 7838646605319 state 0x0 ref 1 00000100:00100000:1.0:1777580317.739061:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838646705319 time 7838646605319 state 0x1 ref 1 00000100:00100000:0.0:1777580317.739557:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838646705319 time 7838688415267 state 0x0 ref 1 00000100:00100000:0.0:1777580317.742943:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283413:x1863919946772352:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580317.743027:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580317.743065:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4cf5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed4b expref: 114 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743094:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4c776 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb68 expref: 113 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743160:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580317.743167:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.743204:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743221:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743233:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743249:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743255:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.743261:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.745887:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.745910:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.745925:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580317.758852:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1899, 64 off129728 00000004:00080000:0.0:1777580317.758875:0:205909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7838707740080ns, next at 7839707734919ns, rc = 0 00010000:00010000:0.0:1777580317.759024:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759049:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759063:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759074:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759080:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759087:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759128:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580317.759207:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759214:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580317.759215:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759221:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759224:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759229:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.759230:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4e400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.759234:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759234:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759243:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.759243:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759258:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:1.0:1777580317.759261:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.759267:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759273:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4cf80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.759294:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.759296:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.759298:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580317.764262:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82e:0x0].0x0 (ffffa02484c59e00) 00010000:00010000:0.0:1777580317.764273:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580317.764294:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764309:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cf79 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764355:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764727:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764735:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764742:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.764747:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764756:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764766:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.764769:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.764772:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.764789:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cf6b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.764837:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000903f50a2 reply state 00000000294b2854 transno 8589950993 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.764848:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.765018:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283413:x1863919946772352:12345-192.168.202.9@tcp:36:rm.500 Request processed in 22484us (32507us total) trans 8589950993 rc 0/0 00000100:00100000:0.0:1777580317.765030:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19833 00000100:00100000:0.0:1777580317.765041:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838646705319 time 7838688415267 state 0x2 ref 0 00010000:00010000:3.0:1777580317.772755:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772791:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772801:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772807:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.772813:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772822:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772845:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248a60ed00) 00010000:00010000:3.0:1777580317.772849:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.772855:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.772862:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4cf72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.784436:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580317.788346:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946773120 00000100:00100000:1.0:1777580317.788388:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946773120 00000100:00100000:1.0:1777580317.788458:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838646705319 time 7838688415267 state 0x0 ref 1 00000100:00100000:1.0:1777580317.788477:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838688515267 time 7838688415267 state 0x1 ref 1 00000100:00100000:1.0:1777580317.788537:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838688515267 time 7838737398079 state 0x0 ref 1 00000100:00100000:1.0:1777580317.789264:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283433:x1863919946773120:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580317.789355:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580317.789393:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4c9d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x832:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec10 expref: 113 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789425:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4c85d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x832:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebae expref: 112 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789438:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa0249f048e00) 00010000:00010000:1.0:1777580317.789450:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.789481:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789655:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789669:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789693:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789700:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789721:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789891:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789899:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.789907:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580317.795841:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1900, 64 off129792 00010000:00010000:1.0:1777580317.796053:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796076:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796091:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796102:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796109:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796116:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796154:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.796203:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796210:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796216:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796223:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.796228:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796236:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796250:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa024993df300) 00010000:00010000:1.0:1777580317.796254:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580317.796259:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796265:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4cf95 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x832:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796291:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796298:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796303:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796319:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.796323:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796329:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796338:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.796340:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.796343:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.796348:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4cf87 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.796361:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ba4c0572 reply state 0000000044ee2340 transno 8589950994 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.796371:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.796518:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283433:x1863919946773120:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7949us (12077us total) trans 8589950994 rc 0/0 00000100:00100000:1.0:1777580317.796530:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19834 00000100:00100000:1.0:1777580317.796539:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838688515267 time 7838737398079 state 0x2 ref 0 00010000:00010000:1.0:1777580317.799221:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.799238:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.799251:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.799255:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.799289:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.799309:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x832:0x0].0x0 (ffffa024993df300) 00010000:00010000:1.0:1777580317.799313:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.799318:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.799324:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4cf9c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x832:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.799348:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.799350:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.799351:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580317.834760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.834823:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.835181:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946773248 00000100:00100000:3.0:1777580317.835194:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946773248 00000100:00100000:3.0:1777580317.835259:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838688515267 time 7838737398079 state 0x0 ref 1 00000100:00100000:3.0:1777580317.835273:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838737498079 time 7838737398079 state 0x1 ref 1 00000100:00100000:3.0:1777580317.857022:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946773504 00000100:00100000:3.0:1777580317.857044:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946773504 00000100:00100000:3.0:1777580317.857110:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838737498079 time 7838737398079 state 0x1 ref 2 00000100:00100000:1.0:1777580317.860182:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838809132184 time 7838809032184 state 0x1 ref 2 00000100:00100000:1.0:1777580317.860229:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283458:x1863919946773248:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580317.860263:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.860290:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4cfa3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed52 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862189:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862217:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862232:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862278:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862297:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862304:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862421:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862430:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862436:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862442:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.862447:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862455:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862467:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.862470:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.862477:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862483:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4cfaa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862522:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862529:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862535:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862541:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.862544:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862551:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862567:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024993df900) 00010000:00010000:1.0:1777580317.862570:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.862574:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862580:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4cfb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862629:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4cfa3 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed52 expref: 313 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862641:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.862644:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.862655:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4cfa3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed52 expref: 313 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862667:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a400, rc 0) 00000100:00100000:1.0:1777580317.862769:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283458:x1863919946773248:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2563us (28022us total) trans 0 rc 301/301 00000100:00100000:1.0:1777580317.862791:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19835 00000100:00100000:1.0:1777580317.862843:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838809132184 time 7838811702656 state 0x0 ref 1 00000100:00100000:1.0:1777580317.862860:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283426:x1863919946773504:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580317.862916:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580317.862932:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4c9bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x831:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec09 expref: 113 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862946:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4c82c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x831:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb99 expref: 112 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862958:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa02484c59100) 00010000:00010000:1.0:1777580317.862971:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.862987:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.862995:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863002:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863013:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863026:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863033:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863126:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863163:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863171:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580317.863802:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1895, 64 off129472 00010000:00010000:1.0:1777580317.863876:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863889:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863898:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863905:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863911:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863917:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863945:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.863970:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863975:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863981:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863986:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.863990:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.863996:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864005:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580317.864008:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580317.864011:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864016:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4cfc6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x831:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864034:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864039:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864053:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864058:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.864061:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864067:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864074:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.864077:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.864079:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864084:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4cfb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.864094:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a11e34a3 reply state 000000004fe8879e transno 8589950995 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.864102:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.864203:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283426:x1863919946773504:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1345us (29376us total) trans 8589950995 rc 0/0 00000100:00100000:1.0:1777580317.864213:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19836 00000100:00100000:1.0:1777580317.864220:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838809132184 time 7838811702656 state 0x2 ref 0 00010000:00010000:1.0:1777580317.864255:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864272:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864278:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864283:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.864286:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864292:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864300:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024993dfe00) 00010000:00010000:1.0:1777580317.864303:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.864306:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864312:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4cf8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864508:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.864514:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864521:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.864524:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864530:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864547:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x831:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580317.864549:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.864552:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864558:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4cfcd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x831:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.864570:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.864572:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.864573:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.874563:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.874675:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.874713:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874728:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874737:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874743:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.874750:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874759:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874797:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024993df500) 00010000:00010000:0.0:1777580317.874802:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.874822:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.874830:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4cfbf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.874886:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946773632 00000100:00100000:0.0:1777580317.874898:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946773632 00000100:00100000:0.0:1777580317.874947:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838809132184 time 7838811702656 state 0x0 ref 1 00000100:00100000:0.0:1777580317.874961:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838811802656 time 7838811702656 state 0x1 ref 1 00000100:00100000:0.0:1777580317.874983:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946773888 00000100:00100000:0.0:1777580317.874986:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946773888 00000100:00100000:0.0:1777580317.875000:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838811802656 time 7838811702656 state 0x1 ref 2 00000100:00100000:0.0:1777580317.875020:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838823982610 time 7838823882610 state 0x1 ref 2 00000100:00100000:0.0:1777580317.875032:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283458:x1863919946773632:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.875058:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.875078:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cfd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed59 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.875708:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838823982610 time 7838824568908 state 0x0 ref 2 00000100:00100000:1.0:1777580317.875730:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283419:x1863919946773888:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580317.876808:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580317.876845:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480031600/0xcb2b2f2f7e4c9f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec17 expref: 111 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.876879:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4c7ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x82f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb7d expref: 110 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.876891:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa0249f048900) 00010000:00010000:1.0:1777580317.876902:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.876925:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.876941:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.880077:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.880910:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.880939:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.880948:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.880949:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.880955:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.880959:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.880987:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.880994:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881000:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881072:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881079:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881086:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881094:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.881099:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881107:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881119:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.881122:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.881127:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.881131:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881147:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4cfe2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.881153:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.881160:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881173:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881179:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881185:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881190:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.881192:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881197:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881205:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248a60e300) 00010000:00010000:0.0:1777580317.881207:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.881209:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881214:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f400/0xcb2b2f2f7e4cff0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881263:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cfd4 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed59 expref: 313 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881275:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.881277:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.881373:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ee00/0xcb2b2f2f7e4cfd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed59 expref: 313 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.881386:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ee00, rc 0) 00000100:00100000:0.0:1777580317.881633:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283458:x1863919946773632:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6600us (7083us total) trans 0 rc 301/301 00000100:00100000:0.0:1777580317.881646:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19837 00000040:00080000:1.0:1777580317.890072:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1896, 64 off129536 00010000:00010000:1.0:1777580317.890224:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890248:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890262:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890272:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890299:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890307:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890339:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.890382:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890388:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890395:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890402:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.890407:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890415:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890430:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:1.0:1777580317.890434:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580317.890439:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890447:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4cff7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x82f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890482:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890489:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890505:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890511:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.890514:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890521:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890529:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.890532:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.890534:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.890540:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4cfdb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.890551:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006466c531 reply state 00000000710f45ef transno 8589950996 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.890824:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.890941:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283419:x1863919946773888:12345-192.168.202.9@tcp:36:rm.500 Request processed in 15212us (16259us total) trans 8589950996 rc 0/0 00000100:00100000:1.0:1777580317.890953:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19838 00000100:00100000:1.0:1777580317.890969:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838823982610 time 7838824568908 state 0x2 ref 0 00010000:00010000:1.0:1777580317.891054:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.891061:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.891068:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.891072:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.891078:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.891087:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x82f:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:1.0:1777580317.891089:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.891092:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.891098:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4cffe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x82f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.891114:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.891116:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.891117:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.912158:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.912316:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946774144 00000100:00100000:0.0:1777580317.912329:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946774144 00000100:00100000:0.0:1777580317.912382:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838570047509 time 7838591733341 state 0x0 ref 1 00000100:00100000:0.0:1777580317.912398:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838591833341 time 7838591733341 state 0x1 ref 1 00000100:00100000:0.0:1777580317.912428:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838591833341 time 7838861290133 state 0x0 ref 1 00000100:00100000:0.0:1777580317.912441:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+312:283461:x1863919946774144:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.912467:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.912493:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d005 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed60 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912687:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912708:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912723:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912762:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912770:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.912788:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.913524:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d1:0x0], index 1: 0 00010000:00010000:0.0:1777580317.913735:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d01a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913748:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d01a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913758:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d01a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913814:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913822:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913830:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913837:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.913842:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913896:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913910:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.913913:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.913918:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.913924:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4e400/0xcb2b2f2f7e4d00c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.913942:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f5ad23c5 reply state 000000005f463683 transno 8589950997 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.913951:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.913991:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d005 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed60 expref: 315 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.914009:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d01a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed60 expref: 314 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.914017:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580317.914020:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.914022:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ea00, rc 0) 00000100:00100000:0.0:1777580317.914117:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+315:283461:x1863919946774144:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1678us (1997us total) trans 8589950997 rc 0/0 00000100:00100000:0.0:1777580317.914127:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19839 00000100:00100000:0.0:1777580317.914160:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838591833341 time 7838861290133 state 0x2 ref 0 00000100:00100000:1.0:1777580317.921014:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.921061:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921077:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921085:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921101:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.921108:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921116:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921166:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024993df300) 00010000:00010000:1.0:1777580317.921169:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.921176:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.921183:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4cfe9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.921233:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946774400 00000100:00100000:1.0:1777580317.921245:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946774400 00000100:00100000:1.0:1777580317.921291:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838823982610 time 7838824568908 state 0x0 ref 1 00000100:00100000:1.0:1777580317.921306:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838824668908 time 7838824568908 state 0x1 ref 1 00000100:00100000:1.0:1777580317.921336:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838824668908 time 7838870198258 state 0x0 ref 1 00000100:00100000:1.0:1777580317.921352:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283425:x1863919946774400:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580317.922042:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580317.922070:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4c97c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x830:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebfb expref: 110 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922107:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0238997f400/0xcb2b2f2f7e4c809 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x830:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb92 expref: 109 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922169:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa024aee2da00) 00010000:00010000:1.0:1777580317.922183:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580317.922215:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922232:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922244:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922260:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922267:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922274:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922706:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922717:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.922725:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580317.927479:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1901, 64 off129856 00010000:00010000:1.0:1777580317.927966:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928004:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928019:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928030:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928037:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928044:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928076:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.928108:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928114:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928121:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928128:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.928165:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928175:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928201:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:1.0:1777580317.928204:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580317.928210:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928217:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d036 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x830:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928241:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928247:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928253:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928259:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.928261:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928268:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928275:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580317.928278:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.928282:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.928287:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d028 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580317.928310:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000541c274e reply state 000000007769d9c5 transno 8589950998 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.928321:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.931455:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283425:x1863919946774400:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10091us (10444us total) trans 8589950998 rc 0/0 00000100:00100000:1.0:1777580317.931470:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19840 00000100:00100000:1.0:1777580317.931481:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838824668908 time 7838870198258 state 0x2 ref 0 00010000:00010000:1.0:1777580317.931704:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.931717:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.931729:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.931734:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.931745:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.931942:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x830:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:1.0:1777580317.931946:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.931952:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.931958:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d03d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x830:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.931985:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.931987:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.931997:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580317.937602:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.937634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580317.937757:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937772:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937795:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937802:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.937808:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937816:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937837:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa0248a60ea00) 00010000:00010000:0.0:1777580317.937840:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.937847:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.937854:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d013 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.937908:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946774656 00000100:00100000:0.0:1777580317.937921:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946774656 00000100:00100000:0.0:1777580317.937966:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838591833341 time 7838861290133 state 0x0 ref 1 00000100:00100000:0.0:1777580317.937980:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838861390133 time 7838861290133 state 0x1 ref 1 00000100:00100000:0.0:1777580317.938014:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946774912 00000100:00100000:0.0:1777580317.938017:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946774912 00000100:00100000:0.0:1777580317.938030:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838861390133 time 7838861290133 state 0x1 ref 2 00000100:00100000:0.0:1777580317.938052:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887014589 time 7838886914589 state 0x1 ref 2 00000100:00100000:0.0:1777580317.938065:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+315:283461:x1863919946774656:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580317.938176:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.938199:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d01a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed60 expref: 315 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.938211:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580317.938218:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.938309:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.938324:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.938335:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.938511:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f7b90605 reply state 00000000c5bd1b94 transno 8589950999 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.938522:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.938635:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+316:283461:x1863919946774656:12345-192.168.202.9@tcp:36:touch.500 Request processed in 571us (1046us total) trans 8589950999 rc 0/0 00000100:00100000:0.0:1777580317.938644:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19841 00000100:00100000:0.0:1777580317.938681:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887014589 time 7838887543065 state 0x0 ref 1 00000100:00100000:0.0:1777580317.938692:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+315:283462:x1863919946774912:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580317.938704:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.938717:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d04b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed67 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947308:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947338:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947351:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947370:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947377:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.947382:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580317.948012:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f6:0x0], index 0: 0 00010000:00010000:0.0:1777580317.948251:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d060 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948264:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948288:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948337:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948346:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948353:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948360:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.948364:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948372:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948385:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.948388:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.948394:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948401:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d052 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.948420:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000875c3420 reply state 000000000f6c1ea4 transno 8589951000 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.948430:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580317.948489:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d04b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed67 expref: 318 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948507:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed67 expref: 317 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.948515:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60e800) 00010000:00010000:0.0:1777580317.948518:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.948521:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32200, rc 0) 00000100:00100000:0.0:1777580317.948610:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283462:x1863919946774912:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9919us (10973us total) trans 8589951000 rc 0/0 00000100:00100000:0.0:1777580317.948621:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19842 00000100:00100000:0.0:1777580317.948630:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887014589 time 7838887543065 state 0x2 ref 0 00010000:00010000:1.0:1777580317.954293:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954317:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954326:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954332:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.954338:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954346:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954440:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024993df600) 00010000:00010000:1.0:1777580317.954444:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.954451:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.954458:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d02f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.959544:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580317.959842:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946775168 00000100:00100000:3.0:1777580317.959857:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946775168 00000100:00100000:3.0:1777580317.959908:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838824668908 time 7838870198258 state 0x0 ref 1 00000100:00100000:3.0:1777580317.959925:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838870298258 time 7838870198258 state 0x1 ref 1 00000100:00100000:3.0:1777580317.959960:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838870298258 time 7838908822138 state 0x0 ref 1 00000100:00100000:3.0:1777580317.959973:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283434:x1863919946775168:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580317.960061:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580317.960100:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4c99f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x833:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec02 expref: 109 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960126:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4c8b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x833:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebc3 expref: 108 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960252:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa02493ac1e00) 00010000:00010000:3.0:1777580317.960264:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580317.960295:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960311:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960339:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960356:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960363:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960368:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960518:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960525:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.960532:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580317.961169:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1897, 64 off129600 00010000:00010000:3.0:1777580317.961246:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961256:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961266:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961274:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961290:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961297:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961328:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580317.961340:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580317.961348:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961354:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961359:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.961365:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.962181:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580317.962189:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.962219:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.962235:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa02487fb4100) 00010000:00010000:1.0:1777580317.962238:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580317.962243:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.962248:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d083 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x833:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.962263:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.962265:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580317.962268:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580317.970149:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.970168:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970184:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970204:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x833:0x0].0x0 (ffffa02487fb4100) 00010000:00010000:3.0:1777580317.970207:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580317.970212:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970221:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d07c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x833:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970279:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970299:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970307:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970313:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580317.970316:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970322:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970330:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580317.970332:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580317.970335:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580317.970340:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d06e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580317.970351:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006fa9f74e reply state 000000001e122e28 transno 8589951001 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580317.970362:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580317.972480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580317.972703:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972718:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972728:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972734:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.972739:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972747:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972804:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa0248a60e300) 00010000:00010000:1.0:1777580317.972808:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.972814:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.972822:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4fe00/0xcb2b2f2f7e4d044 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.972880:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946775296 00000100:00100000:1.0:1777580317.972893:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946775296 00000100:00100000:1.0:1777580317.972941:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887014589 time 7838887543065 state 0x0 ref 1 00000100:00100000:1.0:1777580317.972955:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887643065 time 7838887543065 state 0x1 ref 1 00000100:00100000:1.0:1777580317.972981:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887643065 time 7838921843438 state 0x0 ref 1 00000100:00100000:1.0:1777580317.972994:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+317:283461:x1863919946775296:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.973026:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.973050:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d08a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed6e expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973123:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d08a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed6e expref: 318 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973168:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d08a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed6e expref: 318 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973190:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:1.0:1777580317.973200:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580317.973204:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbda00, rc 0) 00000100:00100000:1.0:1777580317.973280:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239e026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283461:x1863919946775296:12345-192.168.202.9@tcp:101:touch.500 Request processed in 287us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580317.973289:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19844 00000100:00100000:1.0:1777580317.973294:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887643065 time 7838921843438 state 0x2 ref 0 00010000:00010000:1.0:1777580317.973332:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973340:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973346:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.973352:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b600 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:0.0:1777580317.973911:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283434:x1863919946775168:12345-192.168.202.9@tcp:36:rm.500 Request processed in 13935us (14376us total) trans 8589951001 rc 0/0 00000100:00100000:0.0:1777580317.973921:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19843 00000100:00100000:0.0:1777580317.973926:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838870298258 time 7838908822138 state 0x2 ref 0 00010000:00010000:1.0:1777580317.975302:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.975330:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.975352:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa0248a60e600) 00010000:00010000:1.0:1777580317.976710:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.976723:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.976735:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d059 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.991506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.991560:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.991620:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.991640:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.991742:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580317.991947:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946775552 00000100:00100000:0.0:1777580317.991959:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946775552 00000100:00100000:0.0:1777580317.992012:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838887643065 time 7838921843438 state 0x0 ref 1 00000100:00100000:0.0:1777580317.992044:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838921943438 time 7838921843438 state 0x1 ref 1 00000100:00100000:0.0:1777580317.992068:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946775808 00000100:00100000:0.0:1777580317.992071:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946775808 00000100:00100000:0.0:1777580317.992085:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838921943438 time 7838921843438 state 0x1 ref 2 00000100:00100000:0.0:1777580317.992097:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946775936 00000100:00100000:0.0:1777580317.992100:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946775936 00000100:00100000:0.0:1777580317.992111:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838870298258 time 7838908822138 state 0x0 ref 1 00000100:00100000:0.0:1777580317.992116:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838908922138 time 7838908822138 state 0x1 ref 1 00000100:00100000:0.0:1777580317.992128:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776064 00000100:00100000:0.0:1777580317.992130:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776064 00000100:00100000:0.0:1777580317.992169:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838908922138 time 7838908822138 state 0x1 ref 2 00000100:00100000:0.0:1777580317.992177:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776192 00000100:00100000:0.0:1777580317.992179:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776192 00000100:00100000:0.0:1777580317.992189:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838908922138 time 7838908822138 state 0x1 ref 3 00000100:00100000:0.0:1777580317.992203:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838941164667 time 7838941064667 state 0x1 ref 3 00000100:00100000:0.0:1777580317.992215:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283447:x1863919946775936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.992245:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.992272:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d091 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed7c expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992364:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992395:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992410:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992429:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992437:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992444:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992592:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992602:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992609:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.992645:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83c:0x0]: returning size 0 00000004:00200000:0.0:1777580317.992650:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.992674:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992688:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992710:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992717:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992725:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992730:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.992735:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992742:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992755:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.992758:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.992762:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992768:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d098 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992803:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992810:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992814:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992826:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.992829:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992835:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992843:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580317.992845:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.992848:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992854:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d09f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992897:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d091 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed7c expref: 113 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992912:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed7c expref: 112 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.992919:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0248a60e200) 00010000:00010000:0.0:1777580317.992921:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.992924:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c33600, rc 0) 00000100:00100000:0.0:1777580317.993000:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283447:x1863919946775936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 787us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580317.993010:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19847 00000100:00100000:0.0:1777580317.993039:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942001594 time 7838941901594 state 0x1 ref 2 00000100:00100000:0.0:1777580317.993060:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283462:x1863919946775552:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580317.993121:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580317.993165:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d060 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed67 expref: 318 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993177:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60e800) 00010000:00010000:0.0:1777580317.993185:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580317.993255:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993264:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993270:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580317.993430:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000089ddf571 reply state 00000000ada7a7b3 transno 8589951002 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580317.993440:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580317.993491:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+319:283462:x1863919946775552:12345-192.168.202.9@tcp:36:touch.500 Request processed in 434us (1999us total) trans 8589951002 rc 0/0 00000100:00100000:0.0:1777580317.993499:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19845 00000100:00100000:0.0:1777580317.993519:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942481340 time 7838942381340 state 0x1 ref 2 00000100:00100000:0.0:1777580317.993529:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283450:x1863919946776064:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.993540:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.993551:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d0b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed83 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993600:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993610:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993618:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993631:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993639:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993645:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993723:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993733:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993741:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.993762:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83d:0x0]: returning size 0 00000004:00200000:0.0:1777580317.993766:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.993793:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993814:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993821:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993827:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993833:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993838:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.993842:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993848:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993857:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.993860:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.993863:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993869:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d0bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993882:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993887:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993901:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993905:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.993908:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993914:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993921:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580317.993923:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.993925:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993930:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d0c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993957:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d0b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed83 expref: 113 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993970:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed83 expref: 112 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.993977:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:0.0:1777580317.993979:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580317.993981:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:0.0:1777580317.994008:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283450:x1863919946776064:12345-192.168.202.9@tcp:101:rm.500 Request processed in 480us (2366us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580317.994257:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994268:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994274:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994280:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580317.994283:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994288:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994299:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024997a0d00) 00010000:00010000:1.0:1777580317.994301:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580317.994305:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.994311:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d075 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580317.994374:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942001594 time 7838943217617 state 0x0 ref 1 00000100:00100000:1.0:1777580317.994393:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+318:283466:x1863919946775808:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580317.994409:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580317.994422:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d0d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed75 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995885:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995911:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995923:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995943:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995949:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580317.995955:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580317.996924:0:187655:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02393de8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:187655:1863919917498368:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777580317.997016:0:187655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580317.997061:0:187655:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15900 going to sleep for 11 seconds 00000100:00100000:2.0:1777580317.997093:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917498368 00000100:00100000:2.0:1777580317.997102:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917498368 00000100:00100000:2.0:1777580317.997174:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12143 00000100:00100000:2.0:1777580317.997184:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+42:187655:x1863919917498368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1777580317.997247:0:207637:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 5602 00000100:00100000:0.0:1777580317.999238:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19848 00000100:00100000:0.0:1777580317.999323:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942481340 time 7838948181272 state 0x0 ref 1 00000100:00100000:0.0:1777580317.999345:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+110:283456:x1863919946776192:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580317.999369:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580317.999396:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d0e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed8a expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999482:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999500:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999514:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999530:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999536:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999541:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999640:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999648:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999679:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580317.999714:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83f:0x0]: returning size 0 00000004:00200000:0.0:1777580317.999719:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580317.999742:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580317.999834:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d2:0x0], index 1: 0 00010000:00010000:0.0:1777580317.999927:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999936:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999942:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999948:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999954:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580317.999958:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999965:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580317.999978:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580317.999981:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580317.999986:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000002:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d0ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000018:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000024:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000029:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000034:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.000037:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000039:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d101 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000043:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000048:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d101 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000051:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0248a60e500) 00010000:00010000:0.0:1777580318.000054:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.000056:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d101 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000056:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000062:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d0f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000092:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000095:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d0e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed8a expref: 112 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000110:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000116:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000119:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed8a expref: 111 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000121:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.000124:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000127:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:0.0:1777580318.000129:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.000130:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.000132:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7000, rc 0) 00010000:00010000:1.0:1777580318.000161:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.000164:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.000166:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.000171:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d0d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.000181:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002178017b reply state 000000007de499bb transno 8589951003 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.000190:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.000218:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d0d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed75 expref: 321 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.000225:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283456:x1863919946776192:12345-192.168.202.9@tcp:101:rm.500 Request processed in 888us (8483us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580318.000229:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d101 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed75 expref: 320 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.000234:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19849 00000100:00100000:0.0:1777580318.000240:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942481340 time 7838948181272 state 0x2 ref 0 00010000:00010000:1.0:1777580318.000248:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa024993df300) 00010000:00010000:1.0:1777580318.000250:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.000252:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbce00, rc 0) 00000100:00100000:1.0:1777580318.000284:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283466:x1863919946775808:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5898us (8723us total) trans 8589951003 rc 0/0 00000100:00100000:1.0:1777580318.000290:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19846 00000100:00100000:1.0:1777580318.000295:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942001594 time 7838943217617 state 0x2 ref 0 00000100:00100000:1.0:1777580318.000468:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.001745:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.005074:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776320 00000100:00100000:0.0:1777580318.005094:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776320 00000100:00100000:0.0:1777580318.005162:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942481340 time 7838948181272 state 0x0 ref 1 00000100:00100000:0.0:1777580318.005179:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838948281272 time 7838948181272 state 0x1 ref 1 00000100:00100000:0.0:1777580318.005223:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838948281272 time 7838954084447 state 0x0 ref 1 00000100:00100000:0.0:1777580318.005244:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283457:x1863919946776320:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.005274:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.005317:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d10f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed91 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005413:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005445:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005459:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005479:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005487:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005494:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005643:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005653:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005661:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.005695:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x840:0x0]: returning size 0 00000004:00200000:0.0:1777580318.005700:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.005722:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.005736:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007264:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007273:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007282:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007289:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.007294:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007304:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007325:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.007329:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.007334:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007341:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d116 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007358:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007365:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.007370:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.008275:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+43:187655:x1863919917498368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11083us (11249us total) trans 8589938682 rc 0/0 00000100:00100000:2.0:1777580318.008290:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12143 00000100:00100000:1.0:1777580318.008953:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.009452:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776448 00000100:00100000:1.0:1777580318.009462:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776448 00000100:00100000:3.0:1777580318.009471:0:187655:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02393de8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:187655:1863919917498368:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1777580318.009498:0:187655:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x15d2:0x0]-[0x280000400:0x1601:0x0] 00000100:00100000:1.0:1777580318.009892:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838954184447 time 7838954084447 state 0x1 ref 2 00000100:00100000:1.0:1777580318.009929:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838954184447 time 7838958791054 state 0x0 ref 2 00000100:00100000:1.0:1777580318.009946:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283455:x1863919946776448:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.009972:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.009974:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.009980:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.009991:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010001:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d12b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed98 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.010009:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa0248a60e600) 00010000:00010000:0.0:1777580318.010011:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.010017:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.010024:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d11d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.010082:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d10f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed91 expref: 115 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.010097:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed91 expref: 114 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010100:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.010105:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:0.0:1777580318.010107:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.010110:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00010000:00010000:1.0:1777580318.010115:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010131:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.010155:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776576 00000100:00100000:0.0:1777580318.010160:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776576 00010000:00010000:1.0:1777580318.010174:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010182:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010188:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.010211:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12144 00000100:00100000:0.0:1777580318.010219:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2361:x1863919946776576:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580318.010343:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010351:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.010603:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946776576:12345-192.168.202.9@tcp:2:touch.500 Request processed in 383us (1653us total) trans 8589938683 rc 0/0 00000100:00100000:0.0:1777580318.010612:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12144 00000100:00080000:0.0:1777580318.010638:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777580318.010664:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283457:x1863919946776320:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5430us (10197us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.010672:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19850 00010000:00010000:1.0:1777580318.010862:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580318.010900:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x83e:0x0]: returning size 0 00000004:00200000:1.0:1777580318.010905:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580318.010925:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010937:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.010946:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011471:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011483:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011489:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.011492:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011870:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011887:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.011890:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.011894:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011901:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d132 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011920:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011926:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011932:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011936:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.011952:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011958:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011967:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024993dfa00) 00010000:00010000:1.0:1777580318.011970:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.011973:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.011979:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d139 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.012028:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d12b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed98 expref: 114 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.012044:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed98 expref: 113 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.012051:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa02481358500) 00010000:00010000:1.0:1777580318.012053:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.012056:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc000, rc 0) 00000100:00100000:1.0:1777580318.012115:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283455:x1863919946776448:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2174us (10373us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.012124:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19851 00000100:00100000:1.0:1777580318.012159:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838954184447 time 7838958791054 state 0x2 ref 0 00000100:00100000:0.0:1777580318.026400:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.026539:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776704 00000100:00100000:2.0:1777580318.026552:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776704 00000100:00100000:0.0:1777580318.026613:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.026635:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580318.027697:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027741:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027761:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027768:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.027774:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027793:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027815:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024993df600) 00010000:00010000:1.0:1777580318.027819:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.027824:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.027832:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d0de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030061:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030082:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030090:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030097:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.030103:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030110:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030131:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60ea00) 00010000:00010000:3.0:1777580318.030151:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.030157:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.030164:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d0ad lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.031366:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776832 00000100:00100000:2.0:1777580318.031383:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776832 00000100:00100000:0.0:1777580318.031415:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.031439:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.031457:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946777088 00000100:00100000:0.0:1777580318.031460:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.031461:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946777088 00000100:00100000:2.0:1777580318.031478:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946776960 00000100:00100000:2.0:1777580318.031481:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946776960 00000100:00100000:0.0:1777580318.031481:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.031506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.031602:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:0.0:1777580318.031636:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777580318.031640:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580318.031653:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946777472 00000100:00100000:0.0:1777580318.031657:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946777472 00000100:00100000:0.0:1777580318.031686:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838954184447 time 7838958791054 state 0x0 ref 1 00000100:00100000:0.0:1777580318.031700:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838958891054 time 7838958791054 state 0x1 ref 1 00000100:00100000:0.0:1777580318.031716:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946777600 00000100:00100000:0.0:1777580318.031719:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946777600 00000100:00100000:0.0:1777580318.031739:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838942001594 time 7838943217617 state 0x0 ref 1 00000100:00100000:0.0:1777580318.031745:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838943317617 time 7838943217617 state 0x1 ref 1 00000100:00100000:2.0:1777580318.031835:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946777216 00000100:00100000:2.0:1777580318.031839:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946777216 00000100:00100000:2.0:1777580318.031873:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12145 00000100:00100000:0.0:1777580318.031873:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946778112 00000100:00100000:0.0:1777580318.031877:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946778112 00000100:00100000:2.0:1777580318.031884:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946776704:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:0.0:1777580318.031889:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838943317617 time 7838943217617 state 0x1 ref 2 00000100:00100000:0.0:1777580318.031905:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838980867838 time 7838980767838 state 0x1 ref 2 00010000:00010000:2.0:1777580318.031909:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1777580318.031912:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+320:283462:x1863919946777600:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.031928:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.031949:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d147 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edc2 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.031965:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ed9f expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032024:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc2 expref: 321 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032042:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc2 expref: 321 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032063:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60e600) 00010000:00010000:0.0:1777580318.032067:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580318.032070:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00000100:00100000:0.0:1777580318.032177:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+321:283462:x1863919946777600:12345-192.168.202.9@tcp:101:touch.500 Request processed in 263us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.032186:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19853 00000100:00100000:0.0:1777580318.032214:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838958891054 time 7838981076496 state 0x0 ref 1 00000100:00100000:0.0:1777580318.032224:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283435:x1863919946777472:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580318.032275:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580318.032398:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4ce30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x834:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eccd expref: 113 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032426:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4c8d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x834:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebd1 expref: 112 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032438:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0241785f800) 00010000:00010000:0.0:1777580318.032450:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580318.032474:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032487:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032496:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032511:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032519:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032524:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032692:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032700:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.032718:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580318.033578:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1902, 64 off129920 00010000:00010000:0.0:1777580318.033679:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033694:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033705:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033714:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033721:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033729:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033761:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580318.033797:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033802:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033808:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033827:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.033832:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033840:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033853:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580318.033856:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580318.033860:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033867:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d163 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x834:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033889:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033895:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033900:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033905:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.033907:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033913:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033932:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.033934:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.033937:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.033943:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d155 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.033953:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fe23a7a6 reply state 00000000a8b2b56d transno 8589951004 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.033961:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.034069:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+113:283435:x1863919946777472:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1838us (2598us total) trans 8589951004 rc 0/0 00000100:00100000:0.0:1777580318.034080:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19852 00000100:00100000:0.0:1777580318.034089:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838958891054 time 7838981076496 state 0x2 ref 0 00000100:00100000:0.0:1777580318.034175:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838980867838 time 7838983037496 state 0x0 ref 1 00000100:00100000:0.0:1777580318.034194:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+320:283467:x1863919946778112:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.034217:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.034232:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d171 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edc9 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.034710:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12146 00000100:00100000:3.0:1777580318.034725:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946776832:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.034736:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.034795:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eda6 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.034826:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15cf:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580318.034854:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.034857:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.034867:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.034884:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.034897:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ee00, rc 0) 00000100:00100000:3.0:1777580318.034939:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946776832:12345-192.168.202.9@tcp:101:rm.500 Request processed in 220us (8326us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.034947:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12146 00000100:00100000:3.0:1777580318.034978:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12147 00000100:00100000:3.0:1777580318.034987:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946777088:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.034999:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.035012:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edb4 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.035033:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f5:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580318.035044:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.035046:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.035050:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.035063:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.035087:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4e400, rc 0) 00000100:00100000:3.0:1777580318.035115:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946777088:12345-192.168.202.9@tcp:101:rm.500 Request processed in 129us (8479us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.035122:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12147 00000100:00100000:3.0:1777580318.035166:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12148 00000100:00100000:3.0:1777580318.035175:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946776960:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.035184:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.035196:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edad expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.035213:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d0:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580318.035223:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.035224:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.035230:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.035242:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.035252:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4f400, rc 0) 00000100:00100000:3.0:1777580318.035275:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946776960:12345-192.168.202.9@tcp:101:rm.500 Request processed in 102us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.035281:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12148 00010000:00010000:0.0:1777580318.035528:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.035546:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.035569:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.035584:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.035591:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.035597:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580318.036084:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f3:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:2.0:1777580318.036107:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.036109:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.036116:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 25 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.036145:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 25 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.036158:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389021000, rc 0) 00000004:00080000:0.0:1777580318.036186:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f7:0x0], index 0: 0 00000100:00100000:2.0:1777580318.036196:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946776704:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4315us (9813us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.036650:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12145 00000100:00100000:3.0:1777580318.036656:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12149 00000100:00100000:3.0:1777580318.036685:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946777216:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.036702:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.036722:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edbb expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.036742:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f4:0x0] initial LVB size: 0, mtime: 0x69f3b91c, atime: 0x69f3b91c, ctime: 0x69f3b91c, blocks: 0x1 00010000:00010000:3.0:1777580318.036754:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.036756:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.036761:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.036774:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 25 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.036795:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4fe00, rc 0) 00010000:00010000:0.0:1777580318.036944:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d1a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.036957:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.036968:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.036984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580318.037014:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037021:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037029:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037035:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:3.0:1777580318.037061:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946777216:12345-192.168.202.9@tcp:101:rm.500 Request processed in 387us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.037067:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12149 00000100:00100000:3.0:1777580318.037095:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946777856 00000100:00100000:3.0:1777580318.037105:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946777856 00000100:00100000:3.0:1777580318.037168:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4249 00000100:00100000:3.0:1777580318.037176:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+323:283461:x1863919946777856:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:0.0:1777580318.037487:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037496:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037509:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.037512:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.037517:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037524:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d18d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.037543:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021cfadcf reply state 00000000ba6bc97c transno 8589951005 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.037551:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580318.037592:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d171 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc9 expref: 325 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037606:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc9 expref: 324 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.037613:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:0.0:1777580318.037616:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.037618:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7800, rc 0) 00000100:00100000:0.0:1777580318.037658:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+325:283467:x1863919946778112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3471us (6056us total) trans 8589951005 rc 0/0 00000100:00100000:0.0:1777580318.037667:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19854 00000100:00100000:0.0:1777580318.037683:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838980867838 time 7838983037496 state 0x2 ref 0 00000100:00100000:0.0:1777580318.037707:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946778368 00000100:00100000:0.0:1777580318.037711:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946778368 00000100:00100000:0.0:1777580318.037732:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838980867838 time 7838983037496 state 0x0 ref 1 00000100:00100000:0.0:1777580318.037742:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838983137496 time 7838983037496 state 0x1 ref 1 00010000:00010000:1.0:1777580318.038101:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580318.038110:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.038118:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580318.038121:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.038171:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.038180:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x834:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:1.0:1777580318.038182:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580318.038185:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.038190:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d16a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x834:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.038208:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.038210:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.038211:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580318.042808:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838983137496 time 7838991631191 state 0x0 ref 1 00000100:00100000:2.0:1777580318.042857:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+325:283466:x1863919946778368:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580318.042961:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580318.043001:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d101 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed75 expref: 325 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.043030:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa024993df300) 00010000:00010000:2.0:1777580318.043044:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.043172:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.043190:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.043202:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.043393:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009e572a16 reply state 000000005a2e65c7 transno 8589951007 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.043405:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.043551:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283466:x1863919946778368:12345-192.168.202.9@tcp:36:touch.500 Request processed in 717us (6566us total) trans 8589951007 rc 0/0 00000100:00100000:2.0:1777580318.043577:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19855 00000100:00100000:2.0:1777580318.043585:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838983137496 time 7838991631191 state 0x2 ref 0 00000100:00080000:1.0:1777580318.046255:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777580318.048792:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048817:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048856:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048862:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.048869:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048877:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048899:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa0248a60e500) 00010000:00010000:2.0:1777580318.048902:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.048908:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.048915:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d15c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.051608:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+325:283461:x1863919946777856:12345-192.168.202.9@tcp:35:touch.500 Request processed in 14417us (20085us total) trans 8589951006 rc 0/0 00000100:00100000:3.0:1777580318.051623:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4249 00000100:00100000:0.0:1777580318.051896:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.051941:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946778624 00000100:00100000:1.0:1777580318.051953:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946778624 00000100:00100000:1.0:1777580318.052007:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12150 00000100:00100000:1.0:1777580318.052017:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2361:x1863919946778624:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580318.052017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.052069:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946778752 00000100:00100000:0.0:1777580318.052074:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946778752 00000100:00100000:0.0:1777580318.052102:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838958891054 time 7838981076496 state 0x0 ref 1 00000100:00100000:0.0:1777580318.052115:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838981176496 time 7838981076496 state 0x1 ref 1 00000100:00100000:0.0:1777580318.052160:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838981176496 time 7839001022236 state 0x0 ref 1 00000100:00100000:0.0:1777580318.052170:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283437:x1863919946778752:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580318.052224:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580318.052258:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4ce53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x836:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecd4 expref: 112 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052280:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4c960 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x836:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebf4 expref: 111 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052291:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa0249f048000) 00010000:00010000:0.0:1777580318.052303:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580318.052330:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052352:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052375:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052392:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052398:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052404:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.052456:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2361:x1863919946778624:12345-192.168.202.9@tcp:2:touch.500 Request processed in 440us (561us total) trans 8589939084 rc 0/0 00000100:00100000:1.0:1777580318.052463:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12150 00010000:00010000:1.0:1777580318.052499:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052507:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052512:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052525:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.052528:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052531:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052535:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052539:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.052541:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052549:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0248a60e800) 00010000:00010000:1.0:1777580318.052552:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.052556:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.052562:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d194 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580318.053101:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1903, 64 off129984 00010000:00010000:0.0:1777580318.053187:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053200:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053209:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053225:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053231:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053238:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053266:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580318.053290:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053296:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053303:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053308:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.053311:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053318:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053326:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:0.0:1777580318.053329:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580318.053332:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053347:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d1c5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x836:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053366:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053372:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053378:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053383:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.053386:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053391:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053399:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.053401:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.053403:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.053407:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d1b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.053415:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000ee98dfd reply state 00000000e3523cd9 transno 8589951008 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.053423:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.053505:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283437:x1863919946778752:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1334us (1483us total) trans 8589951008 rc 0/0 00000100:00100000:0.0:1777580318.053515:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19856 00000100:00100000:0.0:1777580318.053521:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838981176496 time 7839001022236 state 0x2 ref 0 00010000:00010000:3.0:1777580318.054228:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.054245:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.054253:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.054257:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.054265:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.054280:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x836:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:3.0:1777580318.054282:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.054286:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.054292:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d1cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x836:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.054309:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.054311:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.054313:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580318.074695:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.074850:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.074940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.074965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.075484:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946779008 00000100:00100000:1.0:1777580318.075499:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946779008 00000100:00100000:1.0:1777580318.075554:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838983137496 time 7838991631191 state 0x0 ref 1 00000100:00100000:1.0:1777580318.075676:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838991731191 time 7838991631191 state 0x1 ref 1 00000100:00100000:1.0:1777580318.075700:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946779392 00000100:00100000:1.0:1777580318.075704:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946779392 00000100:00100000:1.0:1777580318.075720:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838991731191 time 7838991631191 state 0x1 ref 2 00000100:00100000:1.0:1777580318.075736:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946779264 00000100:00100000:1.0:1777580318.075739:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946779264 00000100:00100000:1.0:1777580318.075749:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838991731191 time 7838991631191 state 0x1 ref 3 00000100:00100000:1.0:1777580318.075770:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839024732324 time 7839024632324 state 0x1 ref 3 00000100:00100000:1.0:1777580318.075815:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283467:x1863919946779008:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580318.075887:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580318.075923:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d1a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc9 expref: 326 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.075950:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:1.0:1777580318.075963:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.076061:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.076077:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.076089:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.076311:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009b780e3c reply state 00000000781e919c transno 8589951009 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.076321:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.076443:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283467:x1863919946779008:12345-192.168.202.9@tcp:36:touch.500 Request processed in 633us (1763us total) trans 8589951009 rc 0/0 00000100:00100000:1.0:1777580318.076452:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19857 00000100:00100000:1.0:1777580318.076482:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839025444922 time 7839025344922 state 0x1 ref 2 00000100:00100000:1.0:1777580318.076494:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283466:x1863919946779392:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.076505:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.076528:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d1da lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edd7 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.076605:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580318.077757:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d1da lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x810:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd7 expref: 327 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.077790:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d1da lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x810:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd7 expref: 327 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.077816:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa02493bbde00) 00010000:00010000:1.0:1777580318.077820:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.077825:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd200, rc 0) 00000100:00100000:1.0:1777580318.077887:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283466:x1863919946779392:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1394us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.077896:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19858 00000100:00100000:1.0:1777580318.077929:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946779904 00000100:00100000:1.0:1777580318.077938:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946779904 00000100:00100000:1.0:1777580318.077965:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7838981176496 time 7839001022236 state 0x0 ref 1 00000100:00100000:1.0:1777580318.077977:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839001122236 time 7839001022236 state 0x1 ref 1 00000100:00100000:1.0:1777580318.077998:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839001122236 time 7839026861055 state 0x0 ref 1 00000100:00100000:1.0:1777580318.078008:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283436:x1863919946779904:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580318.078061:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580318.078081:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4ce6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x835:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecdb expref: 112 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078119:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4c913 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x835:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ebdf expref: 111 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078128:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa0241785f300) 00010000:00010000:1.0:1777580318.078159:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.078183:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078194:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078203:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078219:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078226:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078231:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078369:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078377:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.078384:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.080461:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839025444922 time 7839029312646 state 0x0 ref 1 00000100:00100000:0.0:1777580318.080499:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+326:283468:x1863919946779264:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.080528:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.080552:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d1f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edd0 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080731:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080763:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080791:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080811:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080818:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.080835:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.081954:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.081970:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.081977:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.081983:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.081989:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.081997:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082013:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa02493bbde00) 00010000:00010000:1.0:1777580318.082016:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.082021:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082027:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020600/0xcb2b2f2f7e4d1b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082810:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082825:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082831:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082848:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.082852:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082858:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082871:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0248a60e300) 00010000:00010000:1.0:1777580318.082874:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.082878:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.082884:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d1be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.082931:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946779648 00000100:00100000:1.0:1777580318.082942:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946779648 00000100:00100000:1.0:1777580318.082998:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4250 00000100:00100000:3.0:1777580318.083000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.083008:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+327:283462:x1863919946779648:12345-192.168.202.9@tcp:35:touch.500 00000004:00080000:0.0:1777580318.083829:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d3:0x0], index 1: 0 00010000:00010000:0.0:1777580318.084032:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d20b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084053:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d20b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084065:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d20b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084111:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084119:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084127:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084153:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.084157:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084165:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084177:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.084180:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.084233:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084240:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d1fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.084254:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dc5e97c6 reply state 00000000fbd8aa34 transno 8589951011 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.084264:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580318.084319:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d1f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd0 expref: 330 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084340:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d20b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd0 expref: 329 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.084348:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:0.0:1777580318.084350:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.084352:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7c00, rc 0) 00000100:00100000:1.0:1777580318.084748:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+329:283462:x1863919946779648:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1738us (9804us total) trans 8589951010 rc 0/0 00000100:00100000:1.0:1777580318.084761:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4250 00000100:00100000:0.0:1777580318.086685:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283468:x1863919946779264:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6191us (11708us total) trans 8589951011 rc 0/0 00000100:00100000:0.0:1777580318.086699:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19859 00000100:00100000:0.0:1777580318.086710:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839025444922 time 7839029312646 state 0x2 ref 0 00000100:00100000:1.0:1777580318.086957:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946780032 00000100:00100000:1.0:1777580318.086970:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946780032 00000100:00100000:1.0:1777580318.087012:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839025444922 time 7839029312646 state 0x0 ref 1 00000100:00100000:1.0:1777580318.087027:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839029412646 time 7839029312646 state 0x1 ref 1 00000100:00100000:1.0:1777580318.087083:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839029412646 time 7839035945001 state 0x0 ref 1 00000100:00100000:1.0:1777580318.087096:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+329:283467:x1863919946780032:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.087126:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.087167:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d219 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edde expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087240:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d219 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x811:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edde expref: 330 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087254:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d219 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x811:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edde expref: 330 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087274:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580318.087277:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.087281:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbce00, rc 0) 00000100:00100000:1.0:1777580318.087307:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283467:x1863919946780032:12345-192.168.202.9@tcp:101:touch.500 Request processed in 215us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.087314:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19861 00000100:00100000:1.0:1777580318.087318:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839029412646 time 7839035945001 state 0x2 ref 0 00010000:00010000:1.0:1777580318.087346:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087355:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087362:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087376:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.087382:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087390:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087402:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580318.087405:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.087409:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.087415:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d1d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.089985:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.090044:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946780160 00000100:00100000:1.0:1777580318.090056:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946780160 00000100:00100000:1.0:1777580318.090118:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12151 00000100:00100000:1.0:1777580318.090129:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2363:x1863919946780160:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.092664:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2363:x1863919946780160:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2523us (2675us total) trans 8589938684 rc 0/0 00000100:00100000:1.0:1777580318.092680:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12151 00000040:00080000:1.0:1777580318.093421:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1898, 64 off129664 00010000:00010000:1.0:1777580318.093538:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095664:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095705:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095716:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095724:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095731:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095752:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580318.095795:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095801:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095808:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095814:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.095819:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095827:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095840:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa024993df900) 00010000:00010000:1.0:1777580318.095843:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580318.095856:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095863:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d1ef lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x835:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095888:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095894:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095900:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095906:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.095909:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095915:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095923:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.095925:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.095927:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.095933:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d1e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.095943:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a4d59c64 reply state 00000000c4f5b5dd transno 8589951012 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.095964:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.096093:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283436:x1863919946779904:12345-192.168.202.9@tcp:36:rm.500 Request processed in 18079us (19482us total) trans 8589951012 rc 0/0 00000100:00100000:1.0:1777580318.096104:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19860 00000100:00100000:1.0:1777580318.096113:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839001122236 time 7839026861055 state 0x2 ref 0 00010000:00010000:1.0:1777580318.096180:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580318.096187:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.096194:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580318.096198:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.096205:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.096214:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x835:0x0].0x0 (ffffa024993df900) 00010000:00010000:1.0:1777580318.096217:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580318.096220:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.096227:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d220 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x835:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.096243:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.096245:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.096246:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.101251:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101287:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101296:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101303:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.101309:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101318:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101337:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024c6346000) 00010000:00010000:1.0:1777580318.101340:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.101345:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.101352:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d204 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.114810:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.114864:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.114888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.114911:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946780288 00000100:00100000:1.0:1777580318.114911:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.114924:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946780288 00000100:00100000:3.0:1777580318.114995:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12152 00000100:00100000:3.0:1777580318.115006:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2361:x1863919946780288:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.115020:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.115048:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946780544 00000100:00100000:1.0:1777580318.115052:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946780544 00000100:00100000:1.0:1777580318.115079:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839029412646 time 7839035945001 state 0x0 ref 1 00000100:00100000:1.0:1777580318.115103:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839036045001 time 7839035945001 state 0x1 ref 1 00000100:00100000:1.0:1777580318.115119:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946780800 00000100:00100000:1.0:1777580318.115122:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946780800 00000100:00100000:1.0:1777580318.115911:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839036045001 time 7839035945001 state 0x1 ref 2 00000100:00100000:1.0:1777580318.115944:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946781312 00000100:00100000:1.0:1777580318.115950:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946781312 00000100:00100000:1.0:1777580318.115977:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839001122236 time 7839026861055 state 0x0 ref 1 00000100:00100000:1.0:1777580318.115986:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839026961055 time 7839026861055 state 0x1 ref 1 00000100:00100000:1.0:1777580318.116007:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839026961055 time 7839064868474 state 0x0 ref 1 00000100:00100000:1.0:1777580318.116021:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283441:x1863919946781312:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580318.116088:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580318.116123:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4ce92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x839:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece2 expref: 111 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117408:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4cba5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x839:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec6b expref: 110 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117428:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580318.117440:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.117473:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117489:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117512:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117529:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117535:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117541:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.117576:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2361:x1863919946780288:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2570us (2780us total) trans 8589939085 rc 0/0 00000100:00100000:3.0:1777580318.117588:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12152 00000100:00100000:3.0:1777580318.117635:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946781056 00000100:00100000:3.0:1777580318.117650:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946781056 00010000:00010000:1.0:1777580318.117692:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117701:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.117708:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.117759:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4251 00000100:00100000:3.0:1777580318.117770:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283466:x1863919946781056:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580318.118065:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+331:283466:x1863919946781056:12345-192.168.202.9@tcp:35:touch.500 Request processed in 297us (3151us total) trans 8589951013 rc 0/0 00000100:00100000:3.0:1777580318.118073:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4251 00000040:00080000:1.0:1777580318.118447:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1899, 64 off129728 00010000:00010000:1.0:1777580318.118504:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.118515:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.118525:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.118534:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.118548:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119068:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119096:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580318.119123:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119131:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119163:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119171:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbdc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.119175:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119183:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119196:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024993df500) 00010000:00010000:1.0:1777580318.119198:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580318.119202:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119208:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d235 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x839:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119243:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119250:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119255:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119260:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.119264:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119270:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119278:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.119281:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.119466:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119475:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d227 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.119497:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1d90f89 reply state 00000000f2f447e3 transno 8589951014 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.119509:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.119618:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+111:283441:x1863919946781312:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3597us (4591us total) trans 8589951014 rc 0/0 00000100:00100000:1.0:1777580318.119628:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19864 00000100:00100000:1.0:1777580318.119645:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839026961055 time 7839064868474 state 0x2 ref 0 00000100:00100000:1.0:1777580318.119692:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839068653262 time 7839068553262 state 0x1 ref 2 00000100:00100000:1.0:1777580318.119708:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283468:x1863919946780544:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580318.119760:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580318.119790:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d20b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd0 expref: 330 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119806:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:1.0:1777580318.119816:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.119899:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119912:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.119923:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.120064:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008570e379 reply state 00000000ba56b6a1 transno 8589951015 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.120072:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.120126:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+331:283468:x1863919946780544:12345-192.168.202.9@tcp:36:touch.500 Request processed in 422us (5261us total) trans 8589951015 rc 0/0 00000100:00100000:1.0:1777580318.120164:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19862 00000100:00100000:1.0:1777580318.120181:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839068653262 time 7839069044393 state 0x0 ref 1 00000100:00100000:1.0:1777580318.120190:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+330:283471:x1863919946780800:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.120207:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.120221:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d24a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ede5 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120350:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120361:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120370:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120388:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120395:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.120402:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580318.120915:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f8:0x0], index 0: 0 00010000:00010000:1.0:1777580318.121083:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d25f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121095:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d25f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121105:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d25f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121209:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121217:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121223:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121230:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.121235:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121242:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121255:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024993dfa00) 00010000:00010000:1.0:1777580318.121258:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.121262:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121269:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d1e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121314:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580318.121322:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121328:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580318.121332:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121347:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121357:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x839:0x0].0x0 (ffffa024993df500) 00010000:00010000:1.0:1777580318.121359:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580318.121363:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121369:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d23c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x839:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121383:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.121385:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.121387:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.121547:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121554:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121560:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121566:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.121569:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121575:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121584:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.121592:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.121596:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121602:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d251 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.121612:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008597b11c reply state 00000000c0cc59d5 transno 8589951016 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.121621:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.121663:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d24a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ede5 expref: 333 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121678:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d25f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ede5 expref: 332 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.121685:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa02417834e00) 00010000:00010000:1.0:1777580318.121687:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.121690:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b800, rc 0) 00000100:00100000:1.0:1777580318.121762:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283471:x1863919946780800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1571us (6872us total) trans 8589951016 rc 0/0 00000100:00100000:1.0:1777580318.121771:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19863 00000100:00100000:1.0:1777580318.121794:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839068653262 time 7839069044393 state 0x2 ref 0 00000100:00100000:3.0:1777580318.128198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.128685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.132060:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132082:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132091:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132098:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.132104:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132113:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132234:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:3.0:1777580318.132238:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.132244:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132251:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d243 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132323:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132330:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132336:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132341:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.132344:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132349:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132359:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.132361:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.132365:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132371:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d258 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132391:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132397:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132403:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132417:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.132420:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132427:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132436:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa024993df300) 00010000:00010000:3.0:1777580318.132438:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.132441:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.132446:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d22e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.132958:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946781440 00000100:00100000:1.0:1777580318.132976:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946781440 00000100:00100000:1.0:1777580318.133034:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839068653262 time 7839069044393 state 0x0 ref 1 00000100:00100000:1.0:1777580318.133052:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839069144393 time 7839069044393 state 0x1 ref 1 00000100:00100000:1.0:1777580318.133089:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946781696 00000100:00100000:1.0:1777580318.133094:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946781696 00000100:00100000:1.0:1777580318.133111:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839069144393 time 7839069044393 state 0x1 ref 2 00000100:00100000:1.0:1777580318.133169:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839082095191 time 7839081995191 state 0x1 ref 2 00000100:00100000:1.0:1777580318.133193:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283468:x1863919946781440:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.133233:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.133263:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d26d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edec expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.133347:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d26d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x812:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edec expref: 333 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.135681:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d26d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x812:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edec expref: 333 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.135735:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024993df900) 00010000:00010000:1.0:1777580318.135739:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.135744:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b600, rc 0) 00000100:00100000:1.0:1777580318.135860:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283468:x1863919946781440:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2675us (7677us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.135872:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19865 00000100:00100000:1.0:1777580318.135935:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839082095191 time 7839084795734 state 0x0 ref 1 00000100:00100000:1.0:1777580318.135955:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+332:283471:x1863919946781696:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580318.136039:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580318.136065:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d25f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ede5 expref: 332 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.136082:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa02417834e00) 00010000:00010000:1.0:1777580318.136092:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.136192:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.136206:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.136215:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.138757:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003dcf7276 reply state 0000000020e5895e transno 8589951017 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.138789:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.138955:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283471:x1863919946781696:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3002us (10265us total) trans 8589951017 rc 0/0 00000100:00100000:1.0:1777580318.138966:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19866 00000100:00100000:1.0:1777580318.138975:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839082095191 time 7839084795734 state 0x2 ref 0 00000100:00100000:1.0:1777580318.139083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.139185:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.139291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.139334:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946781952 00000100:00100000:1.0:1777580318.139344:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946781952 00000100:00100000:1.0:1777580318.140977:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839026961055 time 7839064868474 state 0x0 ref 1 00000100:00100000:1.0:1777580318.140995:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839064968474 time 7839064868474 state 0x1 ref 1 00000100:00100000:1.0:1777580318.141062:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782080 00000100:00100000:1.0:1777580318.141069:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782080 00000100:00100000:1.0:1777580318.141082:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839064968474 time 7839064868474 state 0x1 ref 2 00000100:00100000:1.0:1777580318.141104:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839090066984 time 7839089966984 state 0x1 ref 2 00000100:00100000:1.0:1777580318.141119:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283438:x1863919946781952:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580318.141206:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580318.141240:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024813e3000/0xcb2b2f2f7e4cec3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x837:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf0 expref: 109 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141268:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0249f0b5600/0xcb2b2f2f7e4ca63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x837:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec3a expref: 108 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141296:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa02486090900) 00010000:00010000:1.0:1777580318.141310:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.141341:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141364:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141376:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141393:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141417:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141424:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141731:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141740:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.141748:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.143102:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839090066984 time 7839091955322 state 0x0 ref 2 00000100:00100000:0.0:1777580318.143153:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+333:283480:x1863919946782080:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.143179:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.143204:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d290 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edf3 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143316:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143332:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143344:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143360:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143368:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143374:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143489:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143497:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143504:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.143535:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x810:0x0]: returning size 0 00000004:00200000:0.0:1777580318.143539:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.143561:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143586:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143596:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143602:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143609:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143615:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.143620:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143629:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143642:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.143645:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.143650:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143656:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d297 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143673:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143678:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143690:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143694:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.143697:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143702:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143710:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024c6346000) 00010000:00010000:0.0:1777580318.143712:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.143715:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.143719:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d29e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.144182:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d290 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edf3 expref: 335 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.144199:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edf3 expref: 334 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.144206:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa02493bbde00) 00010000:00010000:0.0:1777580318.144208:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.144210:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c8c00, rc 0) 00000100:00100000:0.0:1777580318.144305:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+334:283480:x1863919946782080:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1181us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.144323:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19868 00000040:00080000:1.0:1777580318.145737:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1900, 64 off129792 00010000:00010000:1.0:1777580318.145865:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145885:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145897:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145906:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145912:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145919:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145961:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580318.145989:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.145996:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146001:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146007:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb2000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.146011:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146019:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146032:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:1.0:1777580318.146035:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580318.146039:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146045:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d289 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x837:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146067:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146073:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146089:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146094:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.146097:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146103:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146110:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.146113:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.146116:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.146121:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d27b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.153935:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782336 00000100:00100000:0.0:1777580318.153958:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782336 00000100:00100000:0.0:1777580318.154037:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4252 00000100:00100000:0.0:1777580318.154047:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+334:283467:x1863919946782336:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580318.154652:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+335:283467:x1863919946782336:12345-192.168.202.9@tcp:35:touch.500 Request processed in 604us (15356us total) trans 8589951019 rc 0/0 00000100:00100000:0.0:1777580318.154661:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4252 00000004:00010000:1.0:1777580318.154751:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000eb4a9d8f reply state 00000000c0a6a76f transno 8589951018 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.154768:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.155792:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580318.155803:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.155813:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb3e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580318.155817:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.155828:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.155869:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x837:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:1.0:1777580318.155873:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580318.155878:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.155885:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d2ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x837:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.155910:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.155912:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.155914:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580318.156241:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.156279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.156537:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782592 00000100:00100000:0.0:1777580318.156549:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782592 00000100:00100000:0.0:1777580318.156598:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839082095191 time 7839084795734 state 0x0 ref 1 00000100:00100000:0.0:1777580318.156612:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839084895734 time 7839084795734 state 0x1 ref 1 00000100:00100000:0.0:1777580318.156647:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839084895734 time 7839105508990 state 0x0 ref 1 00000100:00100000:0.0:1777580318.156663:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+335:283471:x1863919946782592:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.156691:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.156715:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d2b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90edfa expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.156906:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x813:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edfa expref: 336 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.156940:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x813:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edfa expref: 336 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.156963:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa024996f9800) 00010000:00010000:0.0:1777580318.156966:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580318.156969:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9800, rc 0) 00000100:00100000:0.0:1777580318.157031:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+336:283471:x1863919946782592:12345-192.168.202.9@tcp:101:touch.500 Request processed in 371us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.157041:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19869 00000100:00100000:0.0:1777580318.157046:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839084895734 time 7839105508990 state 0x2 ref 0 00000100:00100000:0.0:1777580318.158686:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283438:x1863919946781952:12345-192.168.202.9@tcp:36:rm.500 Request processed in 17558us (19590us total) trans 8589951018 rc 0/0 00000100:00100000:0.0:1777580318.158700:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19867 00000100:00100000:0.0:1777580318.158709:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839090066984 time 7839091955322 state 0x2 ref 0 00010000:00010000:3.0:1777580318.159214:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159228:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159238:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159244:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.159251:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159260:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159553:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa024996f9800) 00010000:00010000:3.0:1777580318.159557:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.159563:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.159571:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d274 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.160549:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782464 00000100:00100000:2.0:1777580318.160564:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782464 00000100:00100000:2.0:1777580318.160680:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12153 00000100:00100000:2.0:1777580318.160691:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946782464:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.172576:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.172762:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.176200:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782976 00000100:00100000:0.0:1777580318.176219:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782976 00000100:00100000:0.0:1777580318.176268:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839084895734 time 7839105508990 state 0x0 ref 1 00000100:00100000:0.0:1777580318.176286:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839105608990 time 7839105508990 state 0x1 ref 1 00000100:00100000:0.0:1777580318.176316:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839105608990 time 7839125177999 state 0x0 ref 1 00000100:00100000:0.0:1777580318.176334:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+335:283472:x1863919946782976:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.176359:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.176394:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d2ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee08 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176573:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176592:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176606:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176623:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176631:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.176637:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.177744:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2362:x1863919946782464:12345-192.168.202.9@tcp:2:touch.500 Request processed in 17044us (21453us total) trans 8589938685 rc 0/0 00000100:00100000:2.0:1777580318.177759:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12153 00000100:00100000:2.0:1777580318.177806:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946782720 00000100:00100000:2.0:1777580318.177814:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946782720 00000100:00100000:2.0:1777580318.177858:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12154 00000100:00100000:2.0:1777580318.177885:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2361:x1863919946782720:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.177902:0:207637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1777580318.181407:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d4:0x0], index 1: 0 00010000:00010000:0.0:1777580318.181672:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d2cf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181694:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d2cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181709:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d2cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181759:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181797:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181805:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181811:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.181816:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181825:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181840:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.181843:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.181848:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181854:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d2c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.181875:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000b57f9ea reply state 00000000f76841df transno 8589951020 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.181885:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580318.181933:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d2ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee08 expref: 338 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181950:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d2cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee08 expref: 337 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.181970:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:0.0:1777580318.181972:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.181974:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc400, rc 0) 00000100:00100000:0.0:1777580318.182065:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283472:x1863919946782976:12345-192.168.202.9@tcp:101:touch.500 Request processed in 5737us (9509us total) trans 8589951020 rc 0/0 00000100:00100000:0.0:1777580318.182076:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19870 00000100:00100000:0.0:1777580318.182085:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839105608990 time 7839125177999 state 0x2 ref 0 00010000:00010000:2.0:1777580318.183692:0:207637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee01 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580318.183741:0:207637:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d2:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:2.0:1777580318.183772:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.183783:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.183798:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.183822:0:207637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 18 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.183837:0:207637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389021600, rc 0) 00000100:00100000:2.0:1777580318.185509:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2361:x1863919946782720:12345-192.168.202.9@tcp:101:rm.500 Request processed in 7610us (12730us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.185524:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12154 00000100:00100000:1.0:1777580318.187981:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580318.188060:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188074:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188083:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188091:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.188096:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188104:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188124:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024996f9200) 00010000:00010000:1.0:1777580318.188169:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.188176:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.188183:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd000/0xcb2b2f2f7e4d282 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.188227:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946783232 00000100:00100000:1.0:1777580318.188239:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946783232 00000100:00100000:1.0:1777580318.188287:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839090066984 time 7839091955322 state 0x0 ref 1 00000100:00100000:1.0:1777580318.188301:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839092055322 time 7839091955322 state 0x1 ref 1 00000100:00100000:1.0:1777580318.188329:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839092055322 time 7839137191384 state 0x0 ref 1 00000100:00100000:1.0:1777580318.188342:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283439:x1863919946783232:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580318.191895:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580318.191951:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030e00/0xcb2b2f2f7e4cee6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x838:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecf7 expref: 108 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.191992:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4cb12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x838:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec5d expref: 107 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192010:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024997a0c00) 00010000:00010000:1.0:1777580318.192025:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.192064:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192082:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192111:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192152:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192159:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192168:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192321:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192328:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.192334:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194626:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194648:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194656:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194662:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.194667:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194675:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194693:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024c6346000) 00010000:00010000:3.0:1777580318.194697:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.194702:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.194708:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d2c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580318.196301:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1904, 64 off130048 00010000:00010000:1.0:1777580318.198654:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198679:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198693:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198703:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198717:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198723:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198747:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580318.198789:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198795:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198801:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198808:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.198813:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198821:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198835:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:1.0:1777580318.198838:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580318.198844:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198850:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d2f2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x838:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198889:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198895:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198901:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198906:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.198909:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198915:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198923:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.198925:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.198928:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.198934:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d2e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.198944:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000064de8fdf reply state 000000001583f5f5 transno 8589951021 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.198955:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.199085:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283439:x1863919946783232:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10739us (11110us total) trans 8589951021 rc 0/0 00000100:00100000:1.0:1777580318.199097:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19871 00000100:00100000:1.0:1777580318.199177:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839092055322 time 7839137191384 state 0x2 ref 0 00000100:00100000:1.0:1777580318.199310:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.199946:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.199955:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.199965:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.199968:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.199976:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.199991:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x838:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580318.199994:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.199998:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.200003:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d2f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x838:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.200022:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.200024:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.200025:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580318.200044:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946783488 00000100:00100000:3.0:1777580318.200054:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946783488 00000100:00100000:3.0:1777580318.200111:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4253 00000100:00100000:3.0:1777580318.200121:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+337:283468:x1863919946783488:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580318.200620:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+338:283468:x1863919946783488:12345-192.168.202.9@tcp:35:touch.500 Request processed in 499us (1309us total) trans 8589951022 rc 0/0 00000100:00100000:3.0:1777580318.200629:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4253 00000100:00100000:1.0:1777580318.201943:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.202069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.202090:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.202112:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.202166:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946783616 00000100:00100000:1.0:1777580318.202176:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946783616 00000100:00100000:1.0:1777580318.202235:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12155 00000100:00100000:1.0:1777580318.202246:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2362:x1863919946783616:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580318.202552:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946783872 00000100:00100000:3.0:1777580318.202557:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946783872 00000100:00100000:3.0:1777580318.202584:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839105608990 time 7839125177999 state 0x0 ref 1 00000100:00100000:3.0:1777580318.202606:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839125277999 time 7839125177999 state 0x1 ref 1 00000100:00100000:3.0:1777580318.202624:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784000 00000100:00100000:3.0:1777580318.202627:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784000 00000100:00100000:3.0:1777580318.202638:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839092055322 time 7839137191384 state 0x0 ref 1 00000100:00100000:3.0:1777580318.202645:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839137291384 time 7839137191384 state 0x1 ref 1 00000100:00100000:3.0:1777580318.202659:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784128 00000100:00100000:3.0:1777580318.202663:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784128 00000100:00100000:3.0:1777580318.202673:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839137291384 time 7839137191384 state 0x1 ref 2 00000100:00100000:3.0:1777580318.202691:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839125277999 time 7839151553575 state 0x0 ref 1 00000100:00100000:3.0:1777580318.202701:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248ba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+340:283472:x1863919946783872:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.203682:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580318.203722:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d2cf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee08 expref: 340 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.203854:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:3.0:1777580318.203869:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.203968:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.203985:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.206070:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946783616:12345-192.168.202.9@tcp:2:touch.500 Request processed in 3810us (4117us total) trans 8589939086 rc 0/0 00000100:00100000:1.0:1777580318.206087:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12155 00000100:00100000:1.0:1777580318.206185:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839155142780 time 7839155042780 state 0x1 ref 2 00000100:00100000:1.0:1777580318.206206:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248ba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+339:283475:x1863919946784000:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.206230:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.206256:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d307 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee0f expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206344:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206361:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206375:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206414:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206422:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.206430:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.210328:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839155142780 time 7839159178780 state 0x0 ref 2 00010000:00010000:1.0:1777580318.211178:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211200:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211215:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580318.211274:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x80e:0x0]: returning size 0 00000004:00200000:1.0:1777580318.211280:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580318.211311:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211328:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211340:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211347:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.211386:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+340:283477:x1863919946784128:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.211413:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.211428:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d323 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee16 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.211498:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.211541:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.211908:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.212077:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a356aa1e reply state 00000000973c3c34 transno 8589951023 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.212086:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.212224:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248ba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283472:x1863919946783872:12345-192.168.202.9@tcp:36:touch.500 Request processed in 9521us (10151us total) trans 8589951023 rc 0/0 00000100:00100000:3.0:1777580318.212234:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19872 00000100:00100000:3.0:1777580318.212243:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839125277999 time 7839151553575 state 0x2 ref 0 00010000:00010000:0.0:1777580318.212376:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212388:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212408:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212415:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212435:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212530:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212538:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212545:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.212566:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x80f:0x0]: returning size 0 00000004:00200000:0.0:1777580318.212569:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.212582:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212593:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212602:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212609:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212615:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212622:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.212627:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212641:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212653:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.212656:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.212661:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212667:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d32a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212683:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212688:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212693:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212698:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.212700:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212703:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212709:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02498f4ad00) 00010000:00010000:0.0:1777580318.212711:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.212714:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212725:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d331 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212770:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d323 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee16 expref: 343 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212795:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee16 expref: 342 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.212802:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60e600) 00010000:00010000:0.0:1777580318.212805:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.212808:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bd800, rc 0) 00000100:00100000:0.0:1777580318.212839:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283477:x1863919946784128:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2489us (10725us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.212846:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19874 00010000:00010000:3.0:1777580318.215921:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.215943:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.215952:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.215959:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.215965:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.215974:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.215996:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024993df500) 00010000:00010000:3.0:1777580318.216000:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.216031:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.216039:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d2eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.217952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.220807:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580318.225785:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02392cb2000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.225805:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225824:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225849:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.225852:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.225859:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225867:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2000/0xcb2b2f2f7e4d30e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225900:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225909:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225915:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225920:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.225922:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225960:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225969:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa024993df300) 00010000:00010000:1.0:1777580318.225971:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.225975:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.225981:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d315 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.226717:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb3e00/0xcb2b2f2f7e4d307 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee0f expref: 342 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.226743:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee0f expref: 341 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.226752:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:1.0:1777580318.226755:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.226758:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd800, rc 0) 00000100:00100000:3.0:1777580318.228130:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.228208:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.228543:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228555:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228564:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228571:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.228583:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228591:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228609:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580318.228612:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.228617:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.228623:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d300 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.228920:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784896 00000100:00100000:0.0:1777580318.228934:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784896 00000100:00100000:1.0:1777580318.230522:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784384 00000100:00100000:1.0:1777580318.230535:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784384 00000100:00100000:1.0:1777580318.230752:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839159278780 time 7839159178780 state 0x1 ref 2 00000100:00100000:1.0:1777580318.230792:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784512 00000100:00100000:1.0:1777580318.230796:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784512 00000100:00100000:1.0:1777580318.230813:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839125277999 time 7839151553575 state 0x0 ref 1 00000100:00100000:1.0:1777580318.230821:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839151653575 time 7839151553575 state 0x1 ref 1 00000100:00100000:1.0:1777580318.230862:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839151653575 time 7839179724141 state 0x0 ref 1 00000100:00100000:1.0:1777580318.230883:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283472:x1863919946784512:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.230917:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.230951:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d33f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee1d expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231035:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d33f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x814:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee1d expref: 343 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231055:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d33f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x814:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee1d expref: 343 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231078:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:1.0:1777580318.231082:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.231086:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd400, rc 0) 00000100:00100000:1.0:1777580318.231210:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283472:x1863919946784512:12345-192.168.202.9@tcp:101:touch.500 Request processed in 335us (10414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.231218:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19876 00000100:00100000:1.0:1777580318.231224:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839151653575 time 7839179724141 state 0x2 ref 0 00000100:00100000:1.0:1777580318.231252:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839159278780 time 7839180115297 state 0x0 ref 2 00000100:00100000:1.0:1777580318.231261:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283443:x1863919946784384:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580318.231312:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580318.231336:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ceca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ece9 expref: 107 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231833:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4cc5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec79 expref: 106 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231851:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa0249f66ff00) 00010000:00010000:1.0:1777580318.231862:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.231887:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231901:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231911:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231929:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231936:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.231944:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.232101:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.232110:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.232118:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.233650:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4254 00000100:00100000:0.0:1777580318.233676:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283471:x1863919946784896:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580318.234232:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283471:x1863919946784896:12345-192.168.202.9@tcp:35:touch.500 Request processed in 567us (6021us total) trans 8589951024 rc 0/0 00000100:00100000:0.0:1777580318.234242:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4254 00000040:00080000:1.0:1777580318.243724:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1905, 64 off130112 00010000:00010000:1.0:1777580318.243880:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243903:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243917:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243926:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243932:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243940:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243963:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580318.243992:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.243998:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244004:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244010:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.244015:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244079:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244093:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580318.244097:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580318.244103:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244110:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d354 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244151:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244158:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244164:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244169:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.244172:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244177:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.244185:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.244187:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.244190:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.249274:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d346 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.249658:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007851928 reply state 000000003e8edfd4 transno 8589951025 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.249671:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.249816:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02393727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283443:x1863919946784384:12345-192.168.202.9@tcp:36:rm.500 Request processed in 18547us (32064us total) trans 8589951025 rc 0/0 00000100:00100000:1.0:1777580318.249828:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19875 00000100:00100000:1.0:1777580318.250234:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946784640 00000100:00100000:1.0:1777580318.250246:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946784640 00000100:00100000:1.0:1777580318.250315:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12156 00000100:00100000:1.0:1777580318.250326:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946784640:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.250346:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.250376:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee24 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.250411:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f6:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.250434:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.250437:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.250447:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 20 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.250471:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 20 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.250519:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd000, rc 0) 00000100:00100000:1.0:1777580318.254053:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946784640:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3709us (25907us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.254072:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12156 00010000:00010000:1.0:1777580318.254948:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580318.254962:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.254976:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbdc00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580318.254982:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.254994:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.255017:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83a:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580318.255020:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580318.255026:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.255033:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d35b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.255058:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.255060:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.255062:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580318.255572:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.255614:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255623:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255630:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255635:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.255639:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255646:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255657:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024997a0d00) 00010000:00010000:3.0:1777580318.255660:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.255664:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255691:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d34d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.255738:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946785152 00000100:00100000:3.0:1777580318.255754:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946785152 00000100:00100000:3.0:1777580318.255817:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839180215297 time 7839180115297 state 0x1 ref 2 00000100:00100000:3.0:1777580318.255847:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839180215297 time 7839204709036 state 0x0 ref 2 00000100:00100000:3.0:1777580318.255860:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283444:x1863919946785152:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.255940:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.255964:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4cf2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecfe expref: 106 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255979:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02480030400/0xcb2b2f2f7e4cca8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec87 expref: 105 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.255995:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa0249f66f500) 00010000:00010000:3.0:1777580318.256005:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.256034:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256049:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256061:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256076:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256090:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256097:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256283:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256292:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.256299:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.258947:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1901, 64 off129856 00010000:00010000:3.0:1777580318.259050:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259072:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259085:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259095:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259102:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259109:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259169:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.259200:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259207:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259213:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259219:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.259224:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259231:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259245:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580318.259248:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.259253:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259258:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d377 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259279:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259284:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259300:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259305:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.259307:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259313:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259320:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.259322:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.259325:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259331:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d369 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.259340:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4b87a66 reply state 00000000941ddffc transno 8589951026 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.259350:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.259475:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283444:x1863919946785152:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3610us (3903us total) trans 8589951026 rc 0/0 00000100:00100000:3.0:1777580318.259485:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19877 00010000:00010000:3.0:1777580318.259597:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.259604:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259612:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.259622:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259629:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259638:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83b:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580318.259640:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.259643:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259648:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d37e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.259663:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.259665:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.259666:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580318.261012:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917498496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777580318.261098:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580318.261205:0:188251:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917498496 00000100:00100000:2.0:1777580318.261215:0:188251:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917498496 00000100:00100000:2.0:1777580318.261265:0:188251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1777580318.261274:0:188251:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917498496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777580318.262231:0:188251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3819962368 avail 3817865216 00000100:00100000:2.0:1777580318.262319:0:188251:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+43:3289:x1863919917498496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1042us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.262328:0:188251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1777580318.262470:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917498496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777580318.264607:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.264676:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264692:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264834:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264841:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.264846:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264854:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264874:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa0241785f800) 00010000:00010000:2.0:1777580318.264877:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.264883:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.264890:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d370 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.265459:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917498624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777580318.265717:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580318.268744:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946785280 00000100:00100000:1.0:1777580318.268758:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946785280 00000100:00100000:1.0:1777580318.268833:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12157 00000100:00100000:1.0:1777580318.268843:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2362:x1863919946785280:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.269345:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2362:x1863919946785280:12345-192.168.202.9@tcp:2:touch.500 Request processed in 501us (4748us total) trans 8589938686 rc 0/0 00000100:00100000:1.0:1777580318.269735:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12157 00000100:00100000:1.0:1777580318.269794:0:192556:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917498624 00000100:00100000:1.0:1777580318.269800:0:192556:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917498624 00000100:00100000:1.0:1777580318.271156:0:192556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1777580318.271178:0:192556:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+43:3290:x1863919917498624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777580318.271214:0:192556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3845128192 avail 3843031040 00000100:00100000:1.0:1777580318.271451:0:192556:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+43:3290:x1863919917498624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.271460:0:192556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1777580318.271546:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917498624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777580318.271723:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248ba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283475:x1863919946784000:12345-192.168.202.9@tcp:101:rm.500 Request processed in 65521us (69626us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.271735:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19873 00000100:00100000:1.0:1777580318.271744:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839180215297 time 7839204709036 state 0x2 ref 0 00000100:00100000:3.0:1777580318.275099:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.275169:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946785536 00000100:00100000:3.0:1777580318.275182:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946785536 00000100:00100000:3.0:1777580318.275233:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839180215297 time 7839204709036 state 0x0 ref 1 00000100:00100000:3.0:1777580318.275249:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839204809036 time 7839204709036 state 0x1 ref 1 00000100:00100000:3.0:1777580318.275275:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839204809036 time 7839224137682 state 0x0 ref 1 00000100:00100000:3.0:1777580318.276413:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+105:283456:x1863919946785536:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.276500:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.276537:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d0fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed8a expref: 105 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276585:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2800/0xcb2b2f2f7e4ce37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecc6 expref: 104 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276599:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:3.0:1777580318.276609:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.276641:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276658:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276670:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276686:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276693:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.276699:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.278035:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.278053:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.278064:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.282077:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1902, 64 off129920 00010000:00010000:3.0:1777580318.282242:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282263:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282277:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282287:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282294:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282300:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282321:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.282349:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282354:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282360:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282367:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.282372:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282397:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282412:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.282415:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.282420:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282427:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d393 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282450:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282456:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282461:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282467:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.282470:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282475:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282482:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.282484:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.282486:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.282502:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d385 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.282513:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c3c27aad reply state 00000000952efc85 transno 8589951027 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.282524:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.282644:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+105:283456:x1863919946785536:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7353us (7555us total) trans 8589951027 rc 0/0 00000100:00100000:3.0:1777580318.282655:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19878 00000100:00100000:3.0:1777580318.282665:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839204809036 time 7839224137682 state 0x2 ref 0 00000100:00100000:3.0:1777580318.285419:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.285977:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.286022:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.286036:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.286052:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.286058:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.286071:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.286100:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83f:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.286104:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.286111:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.286175:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d39a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.286204:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.286206:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.286208:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580318.286238:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946785792 00000100:00100000:3.0:1777580318.286249:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946785792 00000100:00100000:3.0:1777580318.286389:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4255 00000100:00100000:3.0:1777580318.286401:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+342:283472:x1863919946785792:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580318.288716:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946785920 00000100:00100000:2.0:1777580318.288732:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946785920 00000100:00100000:2.0:1777580318.288825:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12158 00000100:00100000:2.0:1777580318.288837:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2361:x1863919946785920:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:3.0:1777580318.289222:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283472:x1863919946785792:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2821us (3814us total) trans 8589951028 rc 0/0 00000100:00100000:3.0:1777580318.289233:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4255 00000100:00100000:3.0:1777580318.289322:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.289725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.289846:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946786176 00000100:00100000:3.0:1777580318.289853:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946786176 00000100:00100000:3.0:1777580318.289885:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839151653575 time 7839179724141 state 0x0 ref 1 00000100:00100000:3.0:1777580318.289898:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839179824141 time 7839179724141 state 0x1 ref 1 00000100:00100000:3.0:1777580318.289917:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946786432 00000100:00100000:3.0:1777580318.289919:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946786432 00000100:00100000:3.0:1777580318.289931:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839204809036 time 7839224137682 state 0x0 ref 1 00000100:00100000:3.0:1777580318.289938:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839224237682 time 7839224137682 state 0x1 ref 1 00000100:00100000:3.0:1777580318.289955:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839179824141 time 7839238818023 state 0x0 ref 1 00000100:00100000:3.0:1777580318.289980:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+343:283474:x1863919946786176:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.289998:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.290024:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d3a1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee32 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290255:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290275:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290288:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290307:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290313:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.290319:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.291076:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.291107:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee2b expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580318.291152:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d1:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:2.0:1777580318.291175:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.291191:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.291203:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 20 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.291225:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 20 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.291241:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389020600, rc 0) 00000100:00100000:2.0:1777580318.291312:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2361:x1863919946785920:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2477us (5337us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.291323:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12158 00000004:00080000:3.0:1777580318.295914:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f9:0x0], index 0: 0 00010000:00010000:3.0:1777580318.296190:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296205:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296231:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296238:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.296244:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296253:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296273:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02417834e00) 00010000:00010000:3.0:1777580318.296277:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.296282:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296289:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d38c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.296354:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839224237682 time 7839245211375 state 0x0 ref 1 00000100:00100000:3.0:1777580318.296382:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+104:283455:x1863919946786432:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.296465:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.296486:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d140 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed98 expref: 104 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296502:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc800/0xcb2b2f2f7e4ce06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecbf expref: 103 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296524:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa02481358500) 00010000:00010000:3.0:1777580318.296535:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.296563:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296581:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296592:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296610:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296617:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296624:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296734:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296742:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.296878:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.297532:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1906, 64 off130176 00010000:00010000:3.0:1777580318.297599:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297616:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297625:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297633:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297639:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297646:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297672:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.297703:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297708:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297713:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297719:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.297722:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.297729:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301039:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580318.301050:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.301061:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301074:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d3cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301112:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301120:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301126:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301146:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.301151:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301159:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301168:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.301171:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.301174:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301179:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d3bd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.301211:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000efb3d404 reply state 000000004ee6ca6c transno 8589951030 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.301224:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.301348:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+104:283455:x1863919946786432:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4973us (11617us total) trans 8589951030 rc 0/0 00000100:00100000:3.0:1777580318.301361:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19880 00000100:00100000:3.0:1777580318.301371:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839224237682 time 7839245211375 state 0x2 ref 0 00010000:00010000:3.0:1777580318.301456:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.301463:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301470:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.301473:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301480:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301488:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83e:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580318.301491:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.301494:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301499:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d3d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.301516:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.301518:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.301527:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.303075:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d3d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303103:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303117:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303209:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303217:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303225:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303231:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.303236:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303243:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303255:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.303258:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.303262:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303270:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d3a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.303305:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000da2f52e6 reply state 00000000806fcab8 transno 8589951029 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.303315:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580318.303369:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d3a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee32 expref: 346 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303385:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee32 expref: 345 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.303393:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.303395:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.303397:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32200, rc 0) 00000100:00100000:3.0:1777580318.303468:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+346:283474:x1863919946786176:12345-192.168.202.9@tcp:101:touch.500 Request processed in 13490us (14146us total) trans 8589951029 rc 0/0 00000100:00100000:3.0:1777580318.303478:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19879 00000100:00100000:3.0:1777580318.303487:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839179824141 time 7839238818023 state 0x2 ref 0 00010000:00010000:2.0:1777580318.305545:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305656:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305666:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305672:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.305679:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305688:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305709:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024993df300) 00010000:00010000:2.0:1777580318.305712:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.305742:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.305750:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d3c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.308611:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.308914:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946786688 00000100:00100000:3.0:1777580318.308928:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946786688 00000100:00100000:3.0:1777580318.308974:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839224237682 time 7839245211375 state 0x0 ref 1 00000100:00100000:3.0:1777580318.308989:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839245311375 time 7839245211375 state 0x1 ref 1 00000100:00100000:3.0:1777580318.309022:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839245311375 time 7839257884829 state 0x0 ref 1 00000100:00100000:3.0:1777580318.309036:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283450:x1863919946786688:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.309181:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.309219:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb6800/0xcb2b2f2f7e4d0c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed83 expref: 103 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309250:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4cdb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ecaa expref: 102 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309261:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:3.0:1777580318.309273:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.309304:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309321:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309332:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309350:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309358:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309364:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309518:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309527:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.309543:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.313219:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1903, 64 off129984 00010000:00010000:3.0:1777580318.313318:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313340:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313355:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313365:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313371:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313377:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313401:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.313432:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313437:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313442:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313463:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.313468:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313475:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313489:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa024c6346000) 00010000:00010000:3.0:1777580318.313492:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.313497:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313503:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d3f5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313526:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313532:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313537:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313541:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.313543:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313548:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313568:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.313570:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.313573:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.313578:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d3e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.313593:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007a7285df reply state 000000001261511d transno 8589951031 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.313602:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.313726:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283450:x1863919946786688:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4687us (5121us total) trans 8589951031 rc 0/0 00000100:00100000:3.0:1777580318.313737:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19881 00000100:00100000:3.0:1777580318.316555:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839245311375 time 7839257884829 state 0x2 ref 0 00010000:00010000:3.0:1777580318.316652:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.316665:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.316675:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.316683:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.316689:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317218:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580318.317229:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317238:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580318.317243:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317252:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317271:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83d:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580318.317274:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580318.317280:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317286:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33e00/0xcb2b2f2f7e4d3fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.317322:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.317324:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.317325:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580318.320743:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.322025:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.322050:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024993df500) 00010000:00010000:3.0:1777580318.322053:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.322059:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.322067:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d3af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.322212:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.323501:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.323549:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946786944 00000100:00100000:3.0:1777580318.323560:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946786944 00000100:00100000:3.0:1777580318.323605:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839179824141 time 7839238818023 state 0x0 ref 1 00000100:00100000:3.0:1777580318.323620:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839238918023 time 7839238818023 state 0x1 ref 1 00000100:00100000:3.0:1777580318.323640:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946787200 00000100:00100000:3.0:1777580318.323643:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946787200 00000100:00100000:3.0:1777580318.323653:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839238918023 time 7839238818023 state 0x1 ref 2 00000100:00100000:3.0:1777580318.323671:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839272634245 time 7839272534245 state 0x1 ref 2 00000100:00100000:3.0:1777580318.323682:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+346:283474:x1863919946786944:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.324912:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580318.324959:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d3d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee32 expref: 346 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.325011:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.325025:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.325130:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.325162:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.325172:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.327302:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d19a507 reply state 00000000050e3f6f transno 8589951032 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.327320:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.327476:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+347:283474:x1863919946786944:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3789us (5264us total) trans 8589951032 rc 0/0 00000100:00100000:3.0:1777580318.327488:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19882 00000100:00100000:3.0:1777580318.327531:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839272634245 time 7839276391598 state 0x0 ref 1 00000100:00100000:3.0:1777580318.327550:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+346:283479:x1863919946787200:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.327573:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.327592:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d40a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee39 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.327771:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.327952:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.327965:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.327985:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.327993:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.328000:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580318.329483:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d5:0x0], index 1: 0 00010000:00010000:3.0:1777580318.329726:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d41f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.330908:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d41f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.330934:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d41f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331004:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331012:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331020:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331044:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9bc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.331050:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331058:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331072:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.331076:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.331081:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331088:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d411 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.331109:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bde609c7 reply state 000000000c1815dd transno 8589951033 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.331119:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580318.331193:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d40a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee39 expref: 349 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331212:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d41f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee39 expref: 348 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.331220:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:3.0:1777580318.331223:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.331226:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4d400, rc 0) 00000100:00100000:3.0:1777580318.331310:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283479:x1863919946787200:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3766us (7815us total) trans 8589951033 rc 0/0 00000100:00100000:3.0:1777580318.331328:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19883 00000100:00100000:3.0:1777580318.331338:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839272634245 time 7839276391598 state 0x2 ref 0 00010000:00010000:2.0:1777580318.332506:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332522:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332547:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332643:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.332648:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332657:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332672:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580318.332675:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.332680:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.332686:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32800/0xcb2b2f2f7e4d3ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.348261:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.348303:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.348335:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.348350:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348732:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348742:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348749:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348756:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.348762:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348795:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348819:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa0248a60e300) 00010000:00010000:2.0:1777580318.348822:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.348828:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.348835:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d418 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.353611:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.353620:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.353627:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.353638:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.353660:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa0248a60e900) 00010000:00010000:3.0:1777580318.353663:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.353668:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.353675:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d403 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.353735:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946787456 00000100:00100000:3.0:1777580318.356065:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946787456 00000100:00100000:3.0:1777580318.356125:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839272634245 time 7839276391598 state 0x0 ref 1 00000100:00100000:3.0:1777580318.356158:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839276491598 time 7839276391598 state 0x1 ref 1 00000100:00100000:3.0:1777580318.356194:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946787712 00000100:00100000:3.0:1777580318.356197:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946787712 00000100:00100000:3.0:1777580318.356211:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839276491598 time 7839276391598 state 0x1 ref 2 00000100:00100000:3.0:1777580318.356235:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305197223 time 7839305097223 state 0x1 ref 2 00000100:00100000:3.0:1777580318.356253:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+348:283479:x1863919946787456:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.356327:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580318.356360:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d41f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee39 expref: 348 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.356383:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa0248a60ee00) 00010000:00010000:3.0:1777580318.356396:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.356493:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.356510:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.356521:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.356710:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001fbf960c reply state 000000009b6e4877 transno 8589951034 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.356721:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.356876:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+349:283479:x1863919946787456:12345-192.168.202.9@tcp:36:touch.500 Request processed in 629us (8629us total) trans 8589951034 rc 0/0 00000100:00100000:3.0:1777580318.356884:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19884 00000100:00100000:3.0:1777580318.356909:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305197223 time 7839305772576 state 0x0 ref 1 00000100:00100000:3.0:1777580318.356920:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+348:283482:x1863919946787712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.356932:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.356946:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d434 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee40 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357063:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357075:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357083:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357096:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357103:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357109:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580318.357723:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15fa:0x0], index 0: 0 00010000:00010000:3.0:1777580318.357911:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d449 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357932:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357941:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d449 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357981:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357989:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.357995:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358000:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.358004:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358012:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358023:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.358026:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.358030:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358038:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d43b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.358052:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003b5ab8d7 reply state 00000000f99ff4c8 transno 8589951035 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.358066:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580318.358100:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d434 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee40 expref: 351 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358115:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d449 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee40 expref: 350 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.358123:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:3.0:1777580318.358125:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.358128:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:3.0:1777580318.358220:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283482:x1863919946787712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1300us (9915us total) trans 8589951035 rc 0/0 00000100:00100000:3.0:1777580318.358230:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19885 00000100:00100000:3.0:1777580318.358237:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305197223 time 7839305772576 state 0x2 ref 0 00000100:00100000:3.0:1777580318.364970:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.365087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.365152:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946787840 00000100:00100000:3.0:1777580318.365166:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946787840 00000100:00100000:3.0:1777580318.365222:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305197223 time 7839305772576 state 0x0 ref 1 00000100:00100000:3.0:1777580318.365238:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305872576 time 7839305772576 state 0x1 ref 1 00000100:00100000:3.0:1777580318.365260:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788096 00000100:00100000:3.0:1777580318.365264:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788096 00000100:00100000:3.0:1777580318.365276:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839245311375 time 7839257884829 state 0x0 ref 1 00000100:00100000:3.0:1777580318.365283:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839257984829 time 7839257884829 state 0x1 ref 1 00000100:00100000:3.0:1777580318.365323:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839257984829 time 7839314185027 state 0x0 ref 1 00000100:00100000:3.0:1777580318.365338:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+102:283447:x1863919946788096:12345-192.168.202.9@tcp:36:rm.500 00000100:00100000:1.0:1777580318.365421:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305872576 time 7839314282372 state 0x0 ref 1 00010000:00010000:3.0:1777580318.365426:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1777580318.365435:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283474:x1863919946787840:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.365449:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.365461:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d0a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed7c expref: 102 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.365482:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d457 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee47 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365493:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4cd9d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x83c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eca3 expref: 101 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365505:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa0248a60e200) 00010000:00010000:3.0:1777580318.365516:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.365539:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365553:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365564:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365577:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365584:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365590:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.365737:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d457 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x815:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee47 expref: 352 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365749:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.365754:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d457 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x815:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee47 expref: 352 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365757:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.365765:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.365785:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:1.0:1777580318.365788:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.365791:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbde00, rc 0) 00000100:00100000:1.0:1777580318.365966:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+352:283474:x1863919946787840:12345-192.168.202.9@tcp:101:touch.500 Request processed in 533us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.365975:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19886 00000100:00100000:1.0:1777580318.365981:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305872576 time 7839314282372 state 0x2 ref 0 00000040:00080000:3.0:1777580318.366432:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1907, 64 off130240 00010000:00010000:3.0:1777580318.366506:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366517:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366526:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366534:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366540:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366548:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366570:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.366594:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366612:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366618:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366624:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.366629:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366636:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366648:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:3.0:1777580318.366650:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.366655:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366661:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d46c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x83c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366678:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366684:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366689:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366693:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.366702:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366707:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366715:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.366717:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.366720:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366725:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d45e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.366734:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001f81183c reply state 00000000de9da7ad transno 8589951036 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.366743:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.366825:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+102:283447:x1863919946788096:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1489us (1735us total) trans 8589951036 rc 0/0 00000100:00100000:3.0:1777580318.366833:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19887 00000100:00100000:3.0:1777580318.366838:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839257984829 time 7839314185027 state 0x2 ref 0 00010000:00010000:3.0:1777580318.366881:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.366888:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366895:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.366898:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366905:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366921:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x83c:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:3.0:1777580318.366923:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.366926:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366931:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d473 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x83c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.366944:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.366946:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.366948:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580318.376898:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.376953:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.376966:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.376976:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.376982:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.376987:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.376996:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.377016:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa0248a60e800) 00010000:00010000:3.0:1777580318.377019:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.377041:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.377048:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d42d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.377098:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788224 00000100:00100000:3.0:1777580318.377110:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788224 00000100:00100000:3.0:1777580318.377176:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839305872576 time 7839314282372 state 0x0 ref 1 00000100:00100000:3.0:1777580318.377188:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314382372 time 7839314282372 state 0x1 ref 1 00000100:00100000:3.0:1777580318.377211:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314382372 time 7839326073702 state 0x0 ref 1 00000100:00100000:3.0:1777580318.377224:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283479:x1863919946788224:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.377253:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.377276:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d47a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee4e expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.377351:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d47a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x816:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee4e expref: 352 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.377366:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d47a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x816:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee4e expref: 352 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.377386:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa024993df500) 00010000:00010000:3.0:1777580318.377389:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580318.377391:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32400, rc 0) 00000100:00100000:3.0:1777580318.377475:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+352:283479:x1863919946788224:12345-192.168.202.9@tcp:101:touch.500 Request processed in 253us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.377494:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19888 00000100:00100000:3.0:1777580318.377499:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314382372 time 7839326073702 state 0x2 ref 0 00010000:00010000:2.0:1777580318.380756:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380789:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380798:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380804:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.380810:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380819:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380840:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa0248a60e500) 00010000:00010000:2.0:1777580318.380844:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.380850:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.380881:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d442 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.385086:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.385121:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.385288:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788480 00000100:00100000:3.0:1777580318.385301:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788480 00000100:00100000:3.0:1777580318.385349:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314382372 time 7839326073702 state 0x0 ref 1 00000100:00100000:3.0:1777580318.385366:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839326173702 time 7839326073702 state 0x1 ref 1 00000100:00100000:3.0:1777580318.385386:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788736 00000100:00100000:3.0:1777580318.385389:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788736 00000100:00100000:3.0:1777580318.385401:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839326173702 time 7839326073702 state 0x1 ref 2 00000100:00100000:3.0:1777580318.385422:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839334384352 time 7839334284352 state 0x1 ref 2 00000100:00100000:3.0:1777580318.385434:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+352:283482:x1863919946788480:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.385510:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580318.385544:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d449 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee40 expref: 352 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.385567:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:3.0:1777580318.385578:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.385667:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.385682:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.385709:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.389023:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839334384352 time 7839337871815 state 0x0 ref 2 00000100:00100000:1.0:1777580318.389068:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+351:283497:x1863919946788736:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.389096:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.389129:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d488 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee55 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389347:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389367:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389402:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389417:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389425:0:188495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389431:0:188495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389453:0:188495:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.389462:0:188495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.391912:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000080bda513 reply state 00000000b02b5642 transno 8589951037 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.391934:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.392095:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+354:283482:x1863919946788480:12345-192.168.202.9@tcp:36:touch.500 Request processed in 6657us (7016us total) trans 8589951037 rc 0/0 00000100:00100000:3.0:1777580318.392107:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19889 00010000:00010000:3.0:1777580318.392183:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392192:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392199:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392205:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.392210:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392218:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392236:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0248a60ea00) 00010000:00010000:3.0:1777580318.392239:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.392243:0:3274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392277:0:3274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392285:0:3274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392318:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.392325:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d465 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.392455:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.392552:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788864 00000100:00100000:3.0:1777580318.392562:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788864 00000100:00100000:3.0:1777580318.392611:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12159 00000100:00100000:3.0:1777580318.392621:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946788864:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580318.393890:0:188495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.393907:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.394258:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946788864:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1633us (1799us total) trans 8589939087 rc 0/0 00000100:00100000:3.0:1777580318.394270:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12159 00000004:00080000:1.0:1777580318.394792:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d6:0x0], index 1: 0 00010000:00010000:1.0:1777580318.395026:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d49d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395046:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d49d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395073:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d49d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395124:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395169:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395179:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395186:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.395191:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395199:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395212:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.395215:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.395219:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395225:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d48f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.395237:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007e0dca48 reply state 00000000b36115fb transno 8589951038 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.395246:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.395298:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbcc00/0xcb2b2f2f7e4d488 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee55 expref: 355 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395313:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d49d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee55 expref: 354 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.395320:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa024997a0200) 00010000:00010000:1.0:1777580318.395323:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.395325:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbd600, rc 0) 00000100:00100000:1.0:1777580318.395400:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+355:283497:x1863919946788736:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6355us (10278us total) trans 8589951038 rc 0/0 00000100:00100000:1.0:1777580318.395409:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19890 00000100:00100000:1.0:1777580318.395419:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839334384352 time 7839337871815 state 0x2 ref 0 00000100:00100000:3.0:1777580318.407353:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.407444:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.407495:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.407530:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946789248 00000100:00100000:3.0:1777580318.407543:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946789248 00000100:00100000:3.0:1777580318.407591:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839257984829 time 7839314185027 state 0x0 ref 1 00000100:00100000:3.0:1777580318.407606:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314285027 time 7839314185027 state 0x1 ref 1 00000100:00100000:1.0:1777580318.407915:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946788992 00000100:00100000:1.0:1777580318.407922:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946788992 00000100:00100000:1.0:1777580318.407982:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12160 00000100:00100000:1.0:1777580318.407994:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2364:x1863919946788992:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.408528:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2364:x1863919946788992:12345-192.168.202.9@tcp:2:touch.500 Request processed in 535us (1187us total) trans 8589938687 rc 0/0 00000100:00100000:1.0:1777580318.408539:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12160 00000100:00100000:3.0:1777580318.408969:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946789376 00000100:00100000:3.0:1777580318.408976:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946789376 00000100:00100000:3.0:1777580318.409007:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839334384352 time 7839337871815 state 0x0 ref 1 00000100:00100000:3.0:1777580318.409016:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839337971815 time 7839337871815 state 0x1 ref 1 00000100:00100000:3.0:1777580318.409033:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314285027 time 7839357894792 state 0x0 ref 1 00000100:00100000:3.0:1777580318.409044:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283457:x1863919946789248:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.409106:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.409154:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d124 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x840:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed91 expref: 101 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409179:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4cf10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x840:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed28 expref: 100 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409190:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa0248a60e700) 00010000:00010000:3.0:1777580318.409202:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.409229:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409245:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409255:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409269:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409307:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409314:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409452:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409460:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.409467:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411048:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411066:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411073:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411080:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.411085:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411094:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411110:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa024993df300) 00010000:00010000:2.0:1777580318.411113:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.411118:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.411124:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33c00/0xcb2b2f2f7e4d481 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.417080:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1908, 64 off130304 00010000:00010000:3.0:1777580318.417228:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.417252:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.417265:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.417275:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.417282:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.417288:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.424477:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839337971815 time 7839373333834 state 0x0 ref 1 00000100:00100000:3.0:1777580318.424509:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+354:283482:x1863919946789376:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.424541:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.424572:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d4c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee5c expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.424647:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x817:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee5c expref: 355 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.424664:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x817:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee5c expref: 355 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.424683:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:3.0:1777580318.424686:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580318.424689:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9b000, rc 0) 00000100:00100000:3.0:1777580318.426631:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+355:283482:x1863919946789376:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2121us (19117us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.426648:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19892 00000100:00100000:3.0:1777580318.426657:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839337971815 time 7839373333834 state 0x2 ref 0 00000100:00100000:3.0:1777580318.427998:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.429584:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.429615:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.429650:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946789888 00000100:00100000:3.0:1777580318.429660:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946789888 00000100:00100000:3.0:1777580318.429725:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839337971815 time 7839373333834 state 0x0 ref 1 00000100:00100000:3.0:1777580318.429739:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839373433834 time 7839373333834 state 0x1 ref 1 00000100:00100000:3.0:1777580318.429759:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946790144 00000100:00100000:3.0:1777580318.429761:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946790144 00000100:00100000:3.0:1777580318.429769:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839373433834 time 7839373333834 state 0x1 ref 2 00000100:00100000:3.0:1777580318.429801:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839378764426 time 7839378664426 state 0x1 ref 2 00000100:00100000:3.0:1777580318.429814:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+356:283497:x1863919946789888:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.429885:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580318.429916:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d49d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee55 expref: 356 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.429938:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa024997a0200) 00010000:00010000:3.0:1777580318.429949:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.430035:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.430050:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.430061:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.430240:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dba1a0c2 reply state 00000000c68c9e4b transno 8589951040 ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.430250:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.435851:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839378764426 time 7839384705037 state 0x0 ref 2 00000100:00100000:2.0:1777580318.435888:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+356:283483:x1863919946790144:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.435957:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.435984:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d4d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee63 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436184:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436201:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436214:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436230:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436238:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.436244:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.437328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.437887:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946789632 00000100:00100000:3.0:1777580318.437900:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946789632 00000100:00100000:3.0:1777580318.437950:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946790400 00000100:00100000:3.0:1777580318.437952:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946790400 00000100:00100000:3.0:1777580318.437966:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4256 00000100:00100000:3.0:1777580318.437975:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283474:x1863919946789632:12345-192.168.202.9@tcp:35:touch.500 00000004:00080000:2.0:1777580318.439110:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15fb:0x0], index 0: 0 00010000:00010000:2.0:1777580318.439308:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d4ea lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439328:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439342:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d4ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439402:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439410:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439417:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439424:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.439429:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439437:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439450:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.439453:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.439458:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.439463:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d4dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.439476:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b0c1ce98 reply state 00000000f6f63df0 transno 8589951042 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.439485:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.441635:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+361:283474:x1863919946789632:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3645us (13629us total) trans 8589951041 rc 0/0 00000100:00100000:3.0:1777580318.441654:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4256 00000100:00100000:3.0:1777580318.441755:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4257 00000100:00100000:3.0:1777580318.441783:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283479:x1863919946790400:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580318.444080:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+361:283479:x1863919946790400:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2301us (6748us total) trans 8589951043 rc 0/0 00000100:00100000:3.0:1777580318.444096:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4257 00000100:00100000:3.0:1777580318.444272:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.444799:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d4d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee63 expref: 361 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.444857:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d4ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee63 expref: 360 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.444868:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa024993df300) 00010000:00010000:2.0:1777580318.444872:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.444875:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389020800, rc 0) 00000100:00100000:2.0:1777580318.444919:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+361:283483:x1863919946790144:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9048us (15302us total) trans 8589951042 rc 0/0 00000100:00100000:2.0:1777580318.444928:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19894 00010000:00010000:2.0:1777580318.444971:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.444981:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.444988:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.444994:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbdc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.445000:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445007:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445021:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0248a60ea00) 00010000:00010000:2.0:1777580318.445024:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.445027:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445040:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d496 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445244:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580318.445266:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580318.445272:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445279:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9ae00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580318.445282:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445289:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445298:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:2.0:1777580318.445301:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580318.445304:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445310:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d4c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x840:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445319:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.445321:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.445322:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.445334:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445341:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445355:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445360:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.445363:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445369:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445377:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x840:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:2.0:1777580318.445379:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580318.445381:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445387:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d4b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x840:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445409:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445416:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445422:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.445427:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.445430:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.445924:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283497:x1863919946789888:12345-192.168.202.9@tcp:36:touch.500 Request processed in 16107us (16343us total) trans 8589951040 rc 0/0 00000100:00100000:3.0:1777580318.445935:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19893 00000100:00100000:3.0:1777580318.445943:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839378764426 time 7839384705037 state 0x2 ref 0 00010000:00010000:2.0:1777580318.450427:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.450452:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.450455:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.450462:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.450470:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d4ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.452011:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946790528 00000100:00100000:1.0:1777580318.452030:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946790528 00000100:00100000:1.0:1777580318.452097:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12161 00000100:00100000:1.0:1777580318.452110:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2363:x1863919946790528:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.452577:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2363:x1863919946790528:12345-192.168.202.9@tcp:2:touch.500 Request processed in 468us (8303us total) trans 8589939088 rc 0/0 00000100:00100000:1.0:1777580318.452602:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12161 00000004:00010000:2.0:1777580318.455956:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d0e5d7e5 reply state 00000000a2bc7dd1 transno 8589951039 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.455981:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.456237:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+101:283457:x1863919946789248:12345-192.168.202.9@tcp:36:rm.500 Request processed in 47188us (48786us total) trans 8589951039 rc 0/0 00000100:00100000:2.0:1777580318.456249:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19891 00000100:00100000:2.0:1777580318.456258:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314285027 time 7839357894792 state 0x2 ref 0 00000100:00100000:2.0:1777580318.459650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.459682:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.459804:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459818:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459827:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459849:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.459855:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459865:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459887:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa024aee2d900) 00010000:00010000:2.0:1777580318.459890:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.459896:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.459903:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d4e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.459956:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946790784 00000100:00100000:2.0:1777580318.459968:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946790784 00000100:00100000:2.0:1777580318.460009:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839378764426 time 7839384705037 state 0x0 ref 1 00000100:00100000:2.0:1777580318.460022:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839384805037 time 7839384705037 state 0x1 ref 1 00000100:00100000:2.0:1777580318.460042:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791040 00000100:00100000:2.0:1777580318.460044:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791040 00000100:00100000:2.0:1777580318.460054:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839314285027 time 7839357894792 state 0x0 ref 1 00000100:00100000:2.0:1777580318.460060:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839357994792 time 7839357894792 state 0x1 ref 1 00000100:00100000:2.0:1777580318.460080:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839357994792 time 7839408941959 state 0x0 ref 1 00000100:00100000:2.0:1777580318.460090:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283480:x1863919946791040:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580318.460184:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580318.460205:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d2a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x810:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edf3 expref: 360 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460224:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d1da lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x810:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edd7 expref: 359 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460233:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa02493bbde00) 00010000:00010000:2.0:1777580318.460240:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.460267:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460283:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460294:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460310:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460317:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460323:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460473:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460480:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.460494:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580318.461155:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1904, 64 off130048 00000004:00080000:2.0:1777580318.461166:0:188495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7839410030392ns, next at 7840410027381ns, rc = 0 00010000:00010000:2.0:1777580318.461234:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461245:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461253:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461261:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461267:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461273:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461290:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580318.461314:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461321:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461326:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461339:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.461342:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461349:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461359:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580318.461361:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580318.461364:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461370:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d506 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x810:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461388:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461396:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461402:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461406:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.461408:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461414:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461433:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.461435:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.461438:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461444:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d4f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.461455:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f709674e reply state 000000009b01ee74 transno 8589951044 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.461464:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.461568:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02487cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283480:x1863919946791040:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1476us (1881us total) trans 8589951044 rc 0/0 00000100:00100000:2.0:1777580318.461579:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19896 00000100:00100000:2.0:1777580318.461587:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839357994792 time 7839408941959 state 0x2 ref 0 00000100:00100000:2.0:1777580318.461627:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839384805037 time 7839410489672 state 0x0 ref 1 00000100:00100000:2.0:1777580318.461641:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283483:x1863919946790784:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580318.461684:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580318.461700:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d4ea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee63 expref: 359 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461710:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa024993df300) 00010000:00010000:2.0:1777580318.461717:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.461804:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461820:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.461827:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.461908:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000045645ce1 reply state 000000008922b151 transno 8589951045 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.461915:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.461963:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a0416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283483:x1863919946790784:12345-192.168.202.9@tcp:36:touch.500 Request processed in 326us (2327us total) trans 8589951045 rc 0/0 00000100:00100000:2.0:1777580318.461970:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19895 00000100:00100000:2.0:1777580318.461973:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839384805037 time 7839410489672 state 0x2 ref 0 00010000:00010000:2.0:1777580318.462006:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462013:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462018:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462022:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.462025:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462030:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462048:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa0248a60e800) 00010000:00010000:2.0:1777580318.462050:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.462053:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462059:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d4ce lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462099:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580318.462104:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462110:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580318.462113:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462119:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462126:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x810:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580318.462128:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580318.462131:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462164:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d50d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x810:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462175:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.462177:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.462179:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580318.462242:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.462378:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791168 00000100:00100000:2.0:1777580318.462388:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791168 00000100:00100000:2.0:1777580318.462417:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839384805037 time 7839410489672 state 0x0 ref 1 00000100:00100000:2.0:1777580318.462429:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839410589672 time 7839410489672 state 0x1 ref 1 00000100:00100000:2.0:1777580318.462449:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839410589672 time 7839411313145 state 0x0 ref 1 00000100:00100000:2.0:1777580318.462461:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+359:283497:x1863919946791168:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.462476:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.462489:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d51b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee6a expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462532:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d51b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x818:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee6a expref: 360 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462545:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d51b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x818:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee6a expref: 360 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462562:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580318.462564:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580318.462567:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389021200, rc 0) 00000100:00100000:2.0:1777580318.462595:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283497:x1863919946791168:12345-192.168.202.9@tcp:101:touch.500 Request processed in 136us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.462602:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19897 00000100:00100000:2.0:1777580318.462606:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839410589672 time 7839411313145 state 0x2 ref 0 00010000:00010000:2.0:1777580318.462632:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462647:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462653:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462659:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.462662:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462669:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462677:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024993dfa00) 00010000:00010000:2.0:1777580318.462680:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.462683:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.462689:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d4b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.475383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.478490:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791424 00000100:00100000:3.0:1777580318.478506:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791424 00000100:00100000:3.0:1777580318.478636:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4258 00000100:00100000:3.0:1777580318.478649:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283482:x1863919946791424:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:2.0:1777580318.479007:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479021:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479029:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479059:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.479066:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479074:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479093:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580318.479096:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.479101:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479107:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d4ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479159:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479166:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479170:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479174:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.479177:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479182:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.479185:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+360:283482:x1863919946791424:12345-192.168.202.9@tcp:35:touch.500 Request processed in 539us (3817us total) trans 8589951046 rc 0/0 00000100:00100000:3.0:1777580318.479203:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4258 00010000:00010000:2.0:1777580318.479204:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580318.479206:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.479208:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.479213:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d514 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.494606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.494649:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.494677:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.494689:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791552 00000100:00100000:0.0:1777580318.494697:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.494704:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791552 00000100:00100000:0.0:1777580318.494754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.494756:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839357994792 time 7839408941959 state 0x0 ref 1 00000100:00100000:2.0:1777580318.494782:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839409041959 time 7839408941959 state 0x1 ref 1 00000100:00100000:0.0:1777580318.494788:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.494803:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791680 00000100:00100000:2.0:1777580318.494806:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791680 00000100:00100000:2.0:1777580318.494816:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839410589672 time 7839411313145 state 0x0 ref 1 00000100:00100000:2.0:1777580318.494822:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839411413145 time 7839411313145 state 0x1 ref 1 00000100:00100000:2.0:1777580318.494834:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791808 00000100:00100000:2.0:1777580318.494836:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791808 00000100:00100000:2.0:1777580318.494844:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839409041959 time 7839408941959 state 0x1 ref 2 00000100:00100000:2.0:1777580318.494856:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946791936 00000100:00100000:2.0:1777580318.494858:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946791936 00000100:00100000:2.0:1777580318.494867:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839409041959 time 7839408941959 state 0x1 ref 3 00000100:00100000:2.0:1777580318.494874:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792192 00000100:00100000:2.0:1777580318.494875:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792192 00000100:00100000:2.0:1777580318.494884:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839409041959 time 7839408941959 state 0x1 ref 4 00000100:00100000:2.0:1777580318.494907:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839443869716 time 7839443769716 state 0x1 ref 4 00000100:00100000:2.0:1777580318.494921:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283484:x1863919946791552:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.494949:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.494980:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d522 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee71 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495067:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495087:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495101:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495668:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495681:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495690:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495859:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495869:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495895:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580318.495933:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x811:0x0]: returning size 0 00000004:00200000:2.0:1777580318.495938:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580318.495966:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495980:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495989:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.495996:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496002:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496009:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.496013:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496023:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496036:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.496039:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.496045:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496062:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d529 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496076:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496083:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496089:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496094:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.496097:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496103:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496109:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa024c6346000) 00010000:00010000:2.0:1777580318.496112:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.496114:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496119:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f200/0xcb2b2f2f7e4d530 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496176:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d522 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee71 expref: 365 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496203:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee71 expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496211:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa024993df600) 00010000:00010000:2.0:1777580318.496213:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.496216:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ca00, rc 0) 00000100:00100000:2.0:1777580318.496297:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283484:x1863919946791552:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1378us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.496307:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19898 00000100:00100000:2.0:1777580318.496344:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839411413145 time 7839445204887 state 0x0 ref 1 00000100:00100000:2.0:1777580318.496359:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283483:x1863919946791680:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.496379:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.496393:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d53e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee78 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496427:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d53e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x819:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee78 expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496437:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d53e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x819:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee78 expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496454:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580318.496457:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580318.496459:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4c800, rc 0) 00000100:00100000:2.0:1777580318.496485:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283483:x1863919946791680:12345-192.168.202.9@tcp:101:touch.500 Request processed in 131us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.496492:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19899 00000100:00100000:2.0:1777580318.496496:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839411413145 time 7839445204887 state 0x2 ref 0 00000100:00100000:2.0:1777580318.496513:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445477052 time 7839445377052 state 0x1 ref 3 00000100:00100000:2.0:1777580318.496522:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283486:x1863919946791808:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.496530:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.496537:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d545 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee7f expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496589:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496598:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496606:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496618:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496625:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496631:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496693:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496708:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496715:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580318.496735:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x812:0x0]: returning size 0 00000004:00200000:2.0:1777580318.496738:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580318.496750:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496757:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496764:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496770:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496784:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496789:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.496791:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496797:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496804:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.496813:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.496817:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496822:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d54c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496835:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496840:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496846:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496851:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.496854:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496860:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496868:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024993df300) 00010000:00010000:2.0:1777580318.496870:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.496873:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496878:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d553 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496903:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d545 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee7f expref: 365 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496924:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee7f expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.496931:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024993df900) 00010000:00010000:2.0:1777580318.496933:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.496936:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:2.0:1777580318.496960:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283486:x1863919946791808:12345-192.168.202.9@tcp:101:rm.500 Request processed in 438us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.496966:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19900 00000100:00100000:2.0:1777580318.496984:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445947470 time 7839445847470 state 0x1 ref 2 00000100:00100000:2.0:1777580318.496995:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283490:x1863919946791936:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.497003:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.497011:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d561 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee86 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497041:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497050:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497058:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497071:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497090:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497098:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497184:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497193:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497200:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580318.497221:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x813:0x0]: returning size 0 00000004:00200000:2.0:1777580318.497223:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580318.497233:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497241:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497248:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497254:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497260:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497274:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.497278:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497283:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497291:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.497293:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.497296:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497300:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d568 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497309:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497314:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497319:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497323:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.497325:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497330:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497347:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa02493bbde00) 00010000:00010000:2.0:1777580318.497350:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.497353:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497359:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d56f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497385:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d561 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee86 expref: 365 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497397:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee86 expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497404:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa024996f9800) 00010000:00010000:2.0:1777580318.497406:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.497409:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd600, rc 0) 00000100:00100000:2.0:1777580318.497433:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283490:x1863919946791936:12345-192.168.202.9@tcp:101:rm.500 Request processed in 439us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.497439:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19901 00000100:00100000:2.0:1777580318.497458:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445947470 time 7839446320860 state 0x0 ref 1 00000100:00100000:2.0:1777580318.497469:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+363:283492:x1863919946792192:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.497479:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.497487:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d57d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee8d expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497584:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497592:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497600:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497612:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497618:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.497625:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.499196:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.499217:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.499228:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580318.499270:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x814:0x0]: returning size 0 00000004:00200000:2.0:1777580318.499274:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580318.499298:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.499333:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.499343:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500496:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500513:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500521:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.500526:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500536:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500699:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.500703:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.500709:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500717:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d584 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500738:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500745:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500768:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500795:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.500798:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500805:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500814:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024aee2d900) 00010000:00010000:2.0:1777580318.500816:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.500820:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500826:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d58b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500884:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d57d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee8d expref: 365 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500900:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee8d expref: 364 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.500908:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:2.0:1777580318.500911:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.500914:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fcc00, rc 0) 00000100:00100000:2.0:1777580318.500998:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283492:x1863919946792192:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3529us (6253us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.501018:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19902 00000100:00100000:2.0:1777580318.501027:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445947470 time 7839446320860 state 0x2 ref 0 00000100:00100000:1.0:1777580318.502474:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.503930:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792320 00000100:00100000:0.0:1777580318.503947:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792320 00000100:00100000:0.0:1777580318.504000:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445947470 time 7839446320860 state 0x0 ref 1 00000100:00100000:0.0:1777580318.504015:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839446420860 time 7839446320860 state 0x1 ref 1 00000100:00100000:0.0:1777580318.504056:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839446420860 time 7839452917603 state 0x0 ref 1 00000100:00100000:0.0:1777580318.504075:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+364:283504:x1863919946792320:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.504102:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.504129:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d599 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee94 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504238:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504254:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504268:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504869:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504885:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.504894:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505083:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505093:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505100:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.505182:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x816:0x0]: returning size 0 00000004:00200000:0.0:1777580318.505187:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.505213:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505227:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505239:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505246:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505254:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505260:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.505265:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505273:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.505594:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792064 00000100:00100000:3.0:1777580318.505604:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792064 00000100:00100000:3.0:1777580318.505684:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12162 00000100:00100000:3.0:1777580318.505695:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2361:x1863919946792064:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580318.505976:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.505980:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.505986:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.505994:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d5a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506013:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506020:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506026:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506032:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.506035:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506040:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506046:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02498f4ad00) 00010000:00010000:0.0:1777580318.506049:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.506051:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506058:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d5a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506112:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d599 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee94 expref: 366 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506129:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee94 expref: 365 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.506154:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa024993df500) 00010000:00010000:0.0:1777580318.506156:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.506160:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc400, rc 0) 00000100:00100000:3.0:1777580318.508619:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2361:x1863919946792064:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2912us (13815us total) trans 8589938688 rc 0/0 00000100:00100000:3.0:1777580318.508635:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12162 00000100:00100000:1.0:1777580318.514073:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+365:283504:x1863919946792320:12345-192.168.202.9@tcp:101:rm.500 Request processed in 9988us (11592us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.514089:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19903 00000100:00100000:1.0:1777580318.514099:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839446420860 time 7839452917603 state 0x2 ref 0 00000100:00100000:2.0:1777580318.519292:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.519330:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.519357:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.519392:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792576 00000100:00100000:2.0:1777580318.519404:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792576 00000100:00100000:2.0:1777580318.519455:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792704 00000100:00100000:2.0:1777580318.519458:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792704 00000100:00100000:2.0:1777580318.519478:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792832 00000100:00100000:2.0:1777580318.519480:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792832 00000100:00100000:2.0:1777580318.521118:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12163 00000100:00100000:2.0:1777580318.521131:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946792576:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.521756:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12164 00000100:00100000:1.0:1777580318.521769:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2362:x1863919946792704:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.521792:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.521820:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eea2 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.521851:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d3:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.521871:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.521874:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.521885:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.521903:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.521918:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc800, rc 0) 00000100:00100000:3.0:1777580318.521921:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12165 00000100:00100000:3.0:1777580318.521933:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946792832:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.521941:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.521953:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eea9 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.521971:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f8:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:3.0:1777580318.521981:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.521983:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.521987:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.521992:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946792704:12345-192.168.202.9@tcp:101:rm.500 Request processed in 227us (2661us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580318.521999:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.522006:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32800, rc 0) 00000100:00100000:1.0:1777580318.522022:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12164 00000100:00100000:1.0:1777580318.522227:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.522244:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946792832:12345-192.168.202.9@tcp:101:rm.500 Request processed in 315us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.522257:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12165 00000100:00100000:1.0:1777580318.522263:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.522607:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2362:x1863919946792576:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1477us (3327us total) trans 8589939089 rc 0/0 00000100:00100000:2.0:1777580318.522615:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12163 00000100:00100000:3.0:1777580318.522786:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792448 00000100:00100000:3.0:1777580318.522796:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792448 00000100:00100000:3.0:1777580318.522831:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946792960 00000100:00100000:3.0:1777580318.522834:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946792960 00000100:00100000:3.0:1777580318.522910:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12166 00000100:00100000:3.0:1777580318.522918:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946792448:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.522928:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.522942:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ee9b expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.522961:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f7:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:3.0:1777580318.522973:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.522974:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.522979:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.522992:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 25 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.523003:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c33e00, rc 0) 00000100:00100000:3.0:1777580318.523030:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2361:x1863919946792448:12345-192.168.202.9@tcp:101:rm.500 Request processed in 114us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.523037:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12166 00000100:00100000:3.0:1777580318.523055:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12167 00000100:00100000:3.0:1777580318.523061:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2364:x1863919946792960:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.523117:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.523128:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eeb0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580318.523164:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d4:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:3.0:1777580318.523174:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.523176:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580318.523180:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 24 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.523192:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 24 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.523201:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c33c00, rc 0) 00000100:00100000:3.0:1777580318.523222:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2364:x1863919946792960:12345-192.168.202.9@tcp:101:rm.500 Request processed in 161us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.523228:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12167 00000100:00100000:0.0:1777580318.538899:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.539192:0:205908:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946793088 00000100:00100000:2.0:1777580318.539206:0:205908:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946793088 00000100:00100000:2.0:1777580318.539280:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12168 00000100:00100000:2.0:1777580318.540747:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2363:x1863919946793088:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580318.540789:0:205908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.540820:0:205908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eeb7 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580318.540857:0:205908:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d5:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:2.0:1777580318.540885:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.540895:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580318.540906:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 25 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.540929:0:205908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 25 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.540947:0:205908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680fe00, rc 0) 00000100:00100000:2.0:1777580318.541033:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2363:x1863919946793088:12345-192.168.202.9@tcp:101:rm.500 Request processed in 304us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.544097:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.544248:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.544276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.545291:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946793600 00000100:00100000:0.0:1777580318.545308:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946793600 00000100:00100000:0.0:1777580318.545372:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946793856 00000100:00100000:0.0:1777580318.545376:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946793856 00000100:00100000:2.0:1777580318.545387:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12168 00000100:00100000:0.0:1777580318.545391:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4259 00000100:00100000:0.0:1777580318.545401:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+366:283483:x1863919946793600:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580318.545437:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946793344 00000100:00100000:2.0:1777580318.545441:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946793344 00000100:00100000:2.0:1777580318.545465:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839446420860 time 7839452917603 state 0x0 ref 1 00000100:00100000:2.0:1777580318.545477:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839453017603 time 7839452917603 state 0x1 ref 1 00000100:00100000:0.0:1777580318.545852:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283483:x1863919946793600:12345-192.168.202.9@tcp:35:touch.500 Request processed in 450us (1601us total) trans 8589951047 rc 0/0 00000100:00100000:0.0:1777580318.545859:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4259 00000100:00100000:0.0:1777580318.545874:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4260 00000100:00100000:0.0:1777580318.545882:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+367:283497:x1863919946793856:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580318.545941:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839453017603 time 7839494802083 state 0x0 ref 1 00000100:00100000:2.0:1777580318.545952:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283490:x1863919946793344:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580318.545988:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1777580318.546011:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283497:x1863919946793856:12345-192.168.202.9@tcp:35:touch.500 Request processed in 130us (1733us total) trans 8589951048 rc 0/0 00010000:00010000:2.0:1777580318.546022:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d576 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x813:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee86 expref: 368 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.546035:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4260 00010000:00010000:2.0:1777580318.546043:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d2b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x813:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edfa expref: 366 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546058:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa024996f9800) 00010000:00010000:2.0:1777580318.546076:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.546102:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546118:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546129:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546165:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546173:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.546179:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.547723:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.547747:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.547760:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580318.549377:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1909, 64 off130368 00010000:00010000:2.0:1777580318.549642:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549661:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549722:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549732:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549739:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549746:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549784:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580318.549815:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549822:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549827:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549833:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.549838:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549846:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549859:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580318.549862:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580318.549875:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549882:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d5e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x813:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549905:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549911:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549917:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549922:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.549924:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549930:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549938:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.549940:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.549943:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.549949:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d5d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.549960:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d262d2f reply state 0000000006f6a394 transno 8589951049 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.549981:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.550106:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeeb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+367:283490:x1863919946793344:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4149us (6016us total) trans 8589951049 rc 0/0 00000100:00100000:2.0:1777580318.550117:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19904 00000100:00100000:2.0:1777580318.550126:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839453017603 time 7839494802083 state 0x2 ref 0 00010000:00010000:0.0:1777580318.550257:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580318.550264:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.550271:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580318.550274:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.550279:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.550300:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x813:0x0].0x0 (ffffa0241785f800) 00010000:00010000:0.0:1777580318.550302:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580318.550305:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.550311:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d5ed lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x813:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.550330:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580318.550331:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580318.550333:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580318.567700:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.571996:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.572024:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.572032:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.572040:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.572046:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.573296:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.573320:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024993df300) 00010000:00010000:3.0:1777580318.573323:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.573331:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.573337:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d5df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.575538:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946794112 00000100:00100000:0.0:1777580318.575559:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946794112 00000100:00100000:0.0:1777580318.575623:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839411413145 time 7839445204887 state 0x0 ref 1 00000100:00100000:0.0:1777580318.575640:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445304887 time 7839445204887 state 0x1 ref 1 00000100:00100000:0.0:1777580318.575682:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445304887 time 7839524543870 state 0x0 ref 1 00000100:00100000:0.0:1777580318.575724:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+366:283489:x1863919946794112:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.575789:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.575821:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d5f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eebe expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576017:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576036:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576050:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576069:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576077:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.576083:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580318.576847:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d7:0x0], index 1: 0 00010000:00010000:1.0:1777580318.577070:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d609 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577084:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577108:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577196:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577204:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577210:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577216:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.577221:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577228:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577241:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.577244:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.577250:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577257:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d5fb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.577270:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b0d6502e reply state 00000000eb24c588 transno 8589951050 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.577280:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.577328:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d5f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eebe expref: 369 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577344:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eebe expref: 368 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.577351:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa02499479000) 00010000:00010000:1.0:1777580318.577353:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.577356:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc600, rc 0) 00000100:00100000:1.0:1777580318.577460:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+369:283489:x1863919946794112:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1745us (9772us total) trans 8589951050 rc 0/0 00000100:00100000:1.0:1777580318.577471:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19905 00000100:00100000:1.0:1777580318.577479:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445304887 time 7839524543870 state 0x2 ref 0 00010000:00010000:3.0:1777580318.585416:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.585440:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.585450:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.585457:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.585464:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.585472:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.585494:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa0249f66ff00) 00010000:00010000:3.0:1777580318.585498:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.585504:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.591010:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d602 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.591396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.591508:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.591540:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946794368 00000100:00100000:3.0:1777580318.591579:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946794624 00000100:00100000:3.0:1777580318.591586:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946794624 00000100:00100000:3.0:1777580318.591634:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839445304887 time 7839524543870 state 0x0 ref 1 00000100:00100000:3.0:1777580318.591649:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839524643870 time 7839524543870 state 0x1 ref 1 00000100:00100000:3.0:1777580318.591724:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839524643870 time 7839540585683 state 0x0 ref 1 00000100:00100000:3.0:1777580318.591738:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+368:283488:x1863919946794624:12345-192.168.202.9@tcp:101:touch.500 00000100:00100000:1.0:1777580318.591758:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946794368 00010000:00010000:3.0:1777580318.591780:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777580318.591787:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839540685683 time 7839540585683 state 0x1 ref 2 00010000:00010000:3.0:1777580318.591804:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d617 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eec5 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.591994:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.592012:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.592025:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.592041:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.592048:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.596312:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580318.598069:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15fc:0x0], index 0: 0 00000100:00100000:0.0:1777580318.598364:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839540685683 time 7839547219292 state 0x0 ref 2 00000100:00100000:0.0:1777580318.598403:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+370:283489:x1863919946794368:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580318.598496:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580318.598535:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d609 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eebe expref: 370 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.598561:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa02499479000) 00010000:00010000:0.0:1777580318.598575:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580318.598681:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.598699:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.598712:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.598888:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000093f02dff reply state 00000000af4ace7f transno 8589951051 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.598899:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.599033:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+371:283489:x1863919946794368:12345-192.168.202.9@tcp:36:touch.500 Request processed in 649us (7643us total) trans 8589951051 rc 0/0 00000100:00100000:0.0:1777580318.599043:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19907 00010000:00010000:3.0:1777580318.599572:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d633 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599585:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599595:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599638:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599646:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599653:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599659:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.599664:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599673:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599685:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.599688:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.599712:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.599719:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d61e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.599736:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000712c705 reply state 000000003876ac83 transno 8589951052 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.601634:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580318.601716:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d617 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eec5 expref: 372 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.601757:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eec5 expref: 371 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.601768:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa0248a60ea00) 00010000:00010000:3.0:1777580318.601779:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.601782:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc800, rc 0) 00000100:00100000:3.0:1777580318.601917:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283488:x1863919946794624:12345-192.168.202.9@tcp:101:touch.500 Request processed in 10182us (10407us total) trans 8589951052 rc 0/0 00000100:00100000:3.0:1777580318.601928:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19906 00000100:00100000:3.0:1777580318.601937:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839540685683 time 7839547219292 state 0x2 ref 0 00000100:00100000:0.0:1777580318.613952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580318.615197:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615205:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615217:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.615218:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615227:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.615227:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615234:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.615234:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.615240:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615246:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.615248:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615253:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615267:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa02498f4ad00) 00010000:00010000:0.0:1777580318.615267:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa0248a60e800) 00010000:00010000:1.0:1777580318.615271:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.615271:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.615276:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.615276:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.615293:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d62c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.615558:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d625 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.616171:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946794752 00000100:00100000:2.0:1777580318.616184:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946794752 00000100:00100000:2.0:1777580318.616231:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839540685683 time 7839547219292 state 0x0 ref 1 00000100:00100000:2.0:1777580318.616244:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839547319292 time 7839547219292 state 0x1 ref 1 00000100:00100000:2.0:1777580318.616272:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839547319292 time 7839565133614 state 0x0 ref 1 00000100:00100000:2.0:1777580318.616296:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+370:283489:x1863919946794752:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.616327:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.616351:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d641 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eecc expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.616424:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d641 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eecc expref: 371 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.616439:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d641 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eecc expref: 371 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.616457:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580318.616460:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580318.616500:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd600, rc 0) 00000100:00100000:2.0:1777580318.616830:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+371:283489:x1863919946794752:12345-192.168.202.9@tcp:101:touch.500 Request processed in 547us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.616839:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19908 00000100:00100000:2.0:1777580318.616843:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839547319292 time 7839565133614 state 0x2 ref 0 00000100:00100000:0.0:1777580318.627476:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.627515:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.627552:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.627753:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795008 00000100:00100000:3.0:1777580318.627768:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795008 00000100:00100000:3.0:1777580318.627832:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839547319292 time 7839565133614 state 0x0 ref 1 00000100:00100000:3.0:1777580318.627848:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839565233614 time 7839565133614 state 0x1 ref 1 00000100:00100000:3.0:1777580318.627875:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795264 00000100:00100000:3.0:1777580318.627899:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795264 00000100:00100000:3.0:1777580318.627914:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839453017603 time 7839494802083 state 0x0 ref 1 00000100:00100000:3.0:1777580318.627922:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839494902083 time 7839494802083 state 0x1 ref 1 00000100:00100000:3.0:1777580318.627944:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839494902083 time 7839576805882 state 0x0 ref 1 00000100:00100000:3.0:1777580318.627955:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283477:x1863919946795264:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.628049:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1777580318.629770:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839565233614 time 7839578625305 state 0x0 ref 1 00000100:00100000:0.0:1777580318.629817:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283488:x1863919946795008:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580318.629879:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580318.629927:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d633 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eec5 expref: 372 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.629951:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa0248a60ea00) 00010000:00010000:0.0:1777580318.629969:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580318.630059:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.630076:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.630212:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d338 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee16 expref: 371 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.630239:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d147 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x80f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edc2 expref: 370 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.630248:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa0248a60e600) 00010000:00010000:3.0:1777580318.630256:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.630275:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.630323:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.630491:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b59ce4b9 reply state 00000000d11beb07 transno 8589951053 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.630502:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.630628:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+371:283488:x1863919946795008:12345-192.168.202.9@tcp:36:touch.500 Request processed in 828us (3165us total) trans 8589951053 rc 0/0 00000100:00100000:0.0:1777580318.630638:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19909 00000100:00100000:0.0:1777580318.630645:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839565233614 time 7839578625305 state 0x2 ref 0 00010000:00010000:3.0:1777580318.631293:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631310:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631335:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631343:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631364:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631507:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631515:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.631521:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580318.632255:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1910, 64 off130432 00010000:00010000:3.0:1777580318.632334:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632346:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632356:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632364:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632371:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632378:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632400:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.632436:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632442:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632448:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632454:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.632459:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632467:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632481:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa024993df300) 00010000:00010000:3.0:1777580318.632484:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.632488:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632494:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d65d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x80f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632514:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632520:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632525:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632540:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.632543:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632549:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632558:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.632560:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.632563:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.632569:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d64f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.632579:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000052834f60 reply state 00000000189bc84d transno 8589951054 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.632588:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580318.632698:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02483f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283477:x1863919946795264:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4739us (5176us total) trans 8589951054 rc 0/0 00000100:00100000:3.0:1777580318.632709:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19910 00000100:00100000:3.0:1777580318.632716:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839494902083 time 7839576805882 state 0x2 ref 0 00000100:00100000:3.0:1777580318.632786:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795392 00000100:00100000:3.0:1777580318.632796:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795392 00000100:00100000:3.0:1777580318.632851:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12169 00000100:00100000:3.0:1777580318.632861:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2364:x1863919946795392:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580318.633181:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946795392:12345-192.168.202.9@tcp:2:touch.500 Request processed in 320us (5627us total) trans 8589938689 rc 0/0 00000100:00100000:3.0:1777580318.633195:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12169 00010000:00010000:3.0:1777580318.633219:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580318.633227:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.633235:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c33600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580318.633238:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.633245:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.633255:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80f:0x0].0x0 (ffffa024993df300) 00010000:00010000:3.0:1777580318.633257:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580318.633261:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.633267:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d664 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.633289:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.633292:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580318.633293:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580318.642598:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.642646:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795520 00000100:00100000:1.0:1777580318.642660:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795520 00000100:00100000:1.0:1777580318.642714:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839565233614 time 7839578625305 state 0x0 ref 1 00000100:00100000:1.0:1777580318.642731:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839578725305 time 7839578625305 state 0x1 ref 1 00000100:00100000:1.0:1777580318.642802:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839578725305 time 7839591634985 state 0x0 ref 1 00000100:00100000:1.0:1777580318.642817:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283488:x1863919946795520:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.642850:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.642876:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d66b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eed3 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.642953:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d66b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eed3 expref: 373 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.642993:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d66b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eed3 expref: 373 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.643018:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa02498f4a100) 00010000:00010000:1.0:1777580318.643021:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.643025:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc000, rc 0) 00000100:00100000:1.0:1777580318.643100:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283488:x1863919946795520:12345-192.168.202.9@tcp:101:touch.500 Request processed in 285us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.643108:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19911 00000100:00100000:1.0:1777580318.643114:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839578725305 time 7839591634985 state 0x2 ref 0 00010000:00010000:3.0:1777580318.644068:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644094:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644102:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644121:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.644126:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644198:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644216:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa02498f4a100) 00010000:00010000:3.0:1777580318.644219:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.644224:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.644231:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d648 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647869:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647890:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647899:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647907:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.647913:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647922:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647943:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa0249f66ff00) 00010000:00010000:1.0:1777580318.647954:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.647961:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.647969:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d656 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.649538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.656087:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795776 00000100:00100000:3.0:1777580318.656109:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795776 00000100:00100000:3.0:1777580318.657453:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839494902083 time 7839576805882 state 0x0 ref 1 00000100:00100000:3.0:1777580318.657474:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839576905882 time 7839576805882 state 0x1 ref 1 00000100:00100000:3.0:1777580318.657528:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839576905882 time 7839606389071 state 0x0 ref 1 00000100:00100000:3.0:1777580318.657646:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+371:283475:x1863919946795776:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580318.657730:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580318.657952:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d31c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee0f expref: 371 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.657978:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d08a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x80e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed6e expref: 370 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658000:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580318.658015:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580318.658047:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658066:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658078:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658096:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658103:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658110:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658297:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658306:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.658313:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.669972:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.670013:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946795904 00000100:00100000:1.0:1777580318.670028:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946795904 00000100:00100000:1.0:1777580318.670095:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12170 00000100:00100000:1.0:1777580318.670107:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+25:2362:x1863919946795904:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.670971:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2362:x1863919946795904:12345-192.168.202.9@tcp:2:touch.500 Request processed in 860us (1004us total) trans 8589939090 rc 0/0 00000100:00100000:1.0:1777580318.670983:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12170 00000100:00100000:1.0:1777580318.671064:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.671457:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946796160 00000100:00100000:0.0:1777580318.671467:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946796160 00000100:00100000:0.0:1777580318.671617:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4261 00000100:00100000:0.0:1777580318.671628:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+370:283489:x1863919946796160:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580318.672040:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+371:283489:x1863919946796160:12345-192.168.202.9@tcp:35:touch.500 Request processed in 413us (974us total) trans 8589951055 rc 0/0 00000100:00100000:0.0:1777580318.672071:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4261 00000100:00100000:0.0:1777580318.676863:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000040:00080000:3.0:1777580318.676941:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1905, 64 off130112 00010000:00010000:3.0:1777580318.677078:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.677940:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946796416 00000100:00100000:2.0:1777580318.677956:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946796416 00000100:00100000:2.0:1777580318.678034:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4262 00000100:00100000:2.0:1777580318.678046:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+372:283488:x1863919946796416:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580318.680461:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283488:x1863919946796416:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2401us (3717us total) trans 8589951057 rc 0/0 00000100:00100000:2.0:1777580318.680479:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4262 00010000:00010000:3.0:1777580318.680787:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680805:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680817:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680824:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680830:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680861:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580318.680895:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680901:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680908:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680914:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.680919:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680928:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680967:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.680970:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580318.680976:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.680983:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d680 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x80e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681010:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681016:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681022:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681027:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.681029:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681035:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681042:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.681044:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.681047:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.681052:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d672 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.681072:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000015f4f2f0 reply state 00000000d821f1aa transno 8589951056 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.681082:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580318.682230:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580318.682246:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.682256:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580318.682261:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.682270:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.682300:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x80e:0x0].0x0 (ffffa02417834f00) 00010000:00010000:0.0:1777580318.682304:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580318.682308:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.682315:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d687 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x80e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.682352:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580318.682355:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580318.682356:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580318.683039:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283475:x1863919946795776:12345-192.168.202.9@tcp:36:rm.500 Request processed in 25489us (33502us total) trans 8589951056 rc 0/0 00000100:00100000:3.0:1777580318.683055:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19912 00000100:00100000:3.0:1777580318.683066:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839576905882 time 7839606389071 state 0x2 ref 0 00000100:00100000:0.0:1777580318.734183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.734229:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946796672 00000100:00100000:0.0:1777580318.734242:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946796672 00000100:00100000:0.0:1777580318.734296:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839578725305 time 7839591634985 state 0x0 ref 1 00000100:00100000:0.0:1777580318.734313:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839591734985 time 7839591634985 state 0x1 ref 1 00000100:00100000:0.0:1777580318.734360:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839591734985 time 7839683221799 state 0x0 ref 1 00000100:00100000:0.0:1777580318.734374:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+373:283496:x1863919946796672:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580318.734409:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.734439:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d68e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eeda expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734638:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734656:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734670:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734687:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734694:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.734700:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.734987:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.734997:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.735003:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.735010:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384c32a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.735016:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.735024:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.735039:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02481358500) 00010000:00010000:3.0:1777580318.735042:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.735047:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.735065:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d679 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777580318.735350:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d8:0x0], index 1: 0 00010000:00010000:0.0:1777580318.735570:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d6a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735581:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735599:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735645:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735652:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735658:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735663:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.735666:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735673:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735681:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.735683:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.735686:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735692:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d695 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.735706:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000df742307 reply state 000000000c032d44 transno 8589951058 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.735716:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580318.735766:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d68e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeda expref: 375 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735802:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeda expref: 374 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.735810:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:0.0:1777580318.735814:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.735817:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:0.0:1777580318.735914:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+375:283496:x1863919946796672:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1542us (1746us total) trans 8589951058 rc 0/0 00000100:00100000:0.0:1777580318.735925:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19913 00000100:00100000:0.0:1777580318.735934:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839591734985 time 7839683221799 state 0x2 ref 0 00010000:00010000:0.0:1777580318.744145:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744168:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744176:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744183:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.744189:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744197:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744218:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02498f4a300) 00010000:00010000:0.0:1777580318.744244:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.744250:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.744257:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d69c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.758028:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.758130:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.758189:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946796928 00000100:00100000:1.0:1777580318.758200:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946796928 00000100:00100000:1.0:1777580318.758247:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839591734985 time 7839683221799 state 0x0 ref 1 00000100:00100000:1.0:1777580318.758263:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839683321799 time 7839683221799 state 0x1 ref 1 00000100:00100000:1.0:1777580318.758282:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946797184 00000100:00100000:1.0:1777580318.758285:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946797184 00000100:00100000:1.0:1777580318.758295:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839683321799 time 7839683221799 state 0x1 ref 2 00000100:00100000:1.0:1777580318.758315:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707276883 time 7839707176883 state 0x1 ref 2 00000100:00100000:1.0:1777580318.758345:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+375:283496:x1863919946796928:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580318.758427:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580318.758463:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d6a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeda expref: 375 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.758505:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:1.0:1777580318.758517:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580318.758615:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.758632:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.758644:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.758830:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021001f55 reply state 00000000d59442cd transno 8589951059 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.758840:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.758960:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+376:283496:x1863919946796928:12345-192.168.202.9@tcp:36:touch.500 Request processed in 616us (944us total) trans 8589951059 rc 0/0 00000100:00100000:1.0:1777580318.758968:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19914 00000100:00100000:1.0:1777580318.758996:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707276883 time 7839707859681 state 0x0 ref 1 00000100:00100000:1.0:1777580318.759007:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+375:283498:x1863919946797184:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.759017:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.759039:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eee1 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759185:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759196:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759204:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759216:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759222:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.759228:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580318.759814:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15fd:0x0], index 0: 0 00010000:00010000:1.0:1777580318.760008:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d6cd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760020:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760029:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760066:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760086:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760093:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760101:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.760106:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760114:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760127:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.760130:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.760168:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760175:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d6bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.760189:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000755c70e3 reply state 000000005e03b411 transno 8589951060 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.760198:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.760232:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee1 expref: 378 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760247:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d6cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee1 expref: 377 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.760267:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa02499479b00) 00010000:00010000:1.0:1777580318.760270:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.760272:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbdc00, rc 0) 00000100:00100000:1.0:1777580318.760334:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+378:283498:x1863919946797184:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1328us (2204us total) trans 8589951060 rc 0/0 00000100:00100000:1.0:1777580318.760343:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19915 00000100:00100000:1.0:1777580318.760350:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707276883 time 7839707859681 state 0x2 ref 0 00000100:00100000:1.0:1777580318.775440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.775476:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.775501:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580318.775897:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775911:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775921:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775927:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.775933:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775942:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775963:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02499479900) 00010000:00010000:3.0:1777580318.775966:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.775971:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.775977:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d6b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.776024:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946797440 00000100:00100000:3.0:1777580318.776035:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946797440 00000100:00100000:2.0:1777580318.776066:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946797568 00000100:00100000:2.0:1777580318.776071:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946797568 00000100:00100000:3.0:1777580318.776082:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707276883 time 7839707859681 state 0x0 ref 1 00000100:00100000:3.0:1777580318.776113:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707959681 time 7839707859681 state 0x1 ref 1 00000100:00100000:3.0:1777580318.776153:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946797824 00000100:00100000:3.0:1777580318.776156:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946797824 00000100:00100000:2.0:1777580318.776915:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839707959681 time 7839707859681 state 0x1 ref 2 00000100:00100000:2.0:1777580318.776950:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839725911923 time 7839725811923 state 0x1 ref 2 00000100:00100000:2.0:1777580318.776972:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+379:283498:x1863919946797440:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580318.777053:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580318.777081:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbdc00/0xcb2b2f2f7e4d6cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee1 expref: 379 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.777204:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839725911923 time 7839726064123 state 0x0 ref 2 00000100:00100000:1.0:1777580318.777219:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+379:283496:x1863919946797568:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.777237:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.777262:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6db lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eee8 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.777318:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726164123 time 7839726064123 state 0x1 ref 3 00010000:00010000:1.0:1777580318.777331:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee8 expref: 380 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.777343:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726164123 time 7839726206567 state 0x0 ref 3 00010000:00010000:1.0:1777580318.777345:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6db lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee8 expref: 380 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.777367:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02499479000) 00010000:00010000:1.0:1777580318.777386:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.777389:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbca00, rc 0) 00000100:00100000:3.0:1777580318.777437:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+380:283500:x1863919946797824:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.777447:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.777458:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d6e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eeef expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.777470:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:283496:x1863919946797568:12345-192.168.202.9@tcp:101:touch.500 Request processed in 254us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.777477:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19917 00010000:00010000:3.0:1777580318.777907:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.777921:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.777932:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.777948:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.777954:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.777960:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.777998:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778007:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778014:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778020:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.778024:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778031:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778041:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02499479700) 00010000:00010000:0.0:1777580318.778044:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.778047:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.778054:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc200/0xcb2b2f2f7e4d6c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.780204:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa02499479b00) 00010000:00010000:2.0:1777580318.780218:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.780327:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.780359:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.780374:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.780544:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004bec4182 reply state 00000000fe1debaf transno 8589951061 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.780556:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.780702:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+380:283498:x1863919946797440:12345-192.168.202.9@tcp:36:touch.500 Request processed in 3735us (5271us total) trans 8589951061 rc 0/0 00000100:00100000:2.0:1777580318.780712:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19916 00000004:00080000:3.0:1777580318.781865:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d9:0x0], index 1: 0 00010000:00010000:3.0:1777580318.782114:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d6fe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.783986:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d6fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784022:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d6fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784113:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784121:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784129:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784155:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389021a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.784161:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784169:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784185:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.784187:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.784194:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784225:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d6e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580318.784244:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000731a6325 reply state 00000000d79945ff transno 8589951062 ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.784256:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580318.784334:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d6e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeef expref: 381 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784352:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d6fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeef expref: 380 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.784360:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02417834f00) 00010000:00010000:3.0:1777580318.784362:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.784365:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32a00, rc 0) 00000100:00100000:3.0:1777580318.784453:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:283500:x1863919946797824:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7101us (8950us total) trans 8589951062 rc 0/0 00000100:00100000:3.0:1777580318.784465:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19918 00000100:00100000:3.0:1777580318.784475:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726164123 time 7839726206567 state 0x2 ref 0 00000100:00100000:3.0:1777580318.788195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.788683:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946797952 00000100:00100000:1.0:1777580318.788697:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946797952 00000100:00100000:1.0:1777580318.788764:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12171 00000100:00100000:1.0:1777580318.788793:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2364:x1863919946797952:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.793845:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2364:x1863919946797952:12345-192.168.202.9@tcp:2:touch.500 Request processed in 5055us (5647us total) trans 8589938690 rc 0/0 00000100:00100000:1.0:1777580318.793864:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12171 00010000:00010000:3.0:1777580318.799057:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799080:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799089:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799116:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.799123:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799132:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799174:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024996f9800) 00010000:00010000:3.0:1777580318.799176:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.799182:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.799188:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d6f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.815249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580318.818331:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818371:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818381:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818388:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.818394:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818403:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818425:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02417834e00) 00010000:00010000:0.0:1777580318.818429:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.818435:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.818443:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d6f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.820799:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946798080 00000100:00100000:3.0:1777580318.820823:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946798080 00000100:00100000:3.0:1777580318.820879:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726164123 time 7839726206567 state 0x0 ref 1 00000100:00100000:1.0:1777580318.821055:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.821106:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.821156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.821545:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726306567 time 7839726206567 state 0x1 ref 1 00000100:00100000:3.0:1777580318.824867:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946798336 00000100:00100000:3.0:1777580318.824890:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946798336 00000100:00100000:3.0:1777580318.824957:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726306567 time 7839726206567 state 0x1 ref 2 00000100:00100000:0.0:1777580318.826335:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946798848 00000100:00100000:0.0:1777580318.826349:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946798848 00000100:00100000:0.0:1777580318.826433:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4263 00000100:00100000:0.0:1777580318.826444:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+381:283496:x1863919946798848:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580318.827166:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+382:283496:x1863919946798848:12345-192.168.202.9@tcp:35:touch.500 Request processed in 721us (6005us total) trans 8589951063 rc 0/0 00000100:00100000:0.0:1777580318.827176:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4263 00000100:00100000:2.0:1777580318.827449:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946798592 00000100:00100000:2.0:1777580318.827456:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946798592 00000100:00100000:2.0:1777580318.827488:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839726306567 time 7839726206567 state 0x1 ref 3 00000100:00100000:2.0:1777580318.827516:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776477795 time 7839776377795 state 0x1 ref 3 00000100:00100000:2.0:1777580318.827529:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+382:283498:x1863919946798080:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.827544:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.827576:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d70c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eef6 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.827638:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d70c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eef6 expref: 383 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.827657:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d70c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eef6 expref: 383 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.827690:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580318.827693:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580318.827697:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fce00, rc 0) 00000100:00100000:2.0:1777580318.827725:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:283498:x1863919946798080:12345-192.168.202.9@tcp:101:touch.500 Request processed in 198us (12490us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580318.827732:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19919 00000100:00100000:2.0:1777580318.827789:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776752197 time 7839776652197 state 0x1 ref 2 00000100:00100000:2.0:1777580318.827801:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+382:283502:x1863919946798336:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580318.827811:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580318.827821:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d713 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eefd expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.827908:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776752197 time 7839776768655 state 0x0 ref 2 00000100:00100000:1.0:1777580318.827922:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+383:283500:x1863919946798592:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580318.827950:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580318.827959:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.827971:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32a00/0xcb2b2f2f7e4d6fe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeef expref: 383 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.827972:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.827983:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.827987:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02417834f00) 00010000:00010000:2.0:1777580318.827999:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.828000:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.828006:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828026:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.828066:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.828081:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.828088:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.828221:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b70c0877 reply state 0000000069653e37 transno 8589951064 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.828231:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580318.828301:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+384:283500:x1863919946798592:12345-192.168.202.9@tcp:36:touch.500 Request processed in 366us (7177us total) trans 8589951064 rc 0/0 00000100:00100000:1.0:1777580318.828307:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19921 00000004:00080000:2.0:1777580318.828567:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15fe:0x0], index 0: 0 00010000:00010000:2.0:1777580318.828732:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d72f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828742:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d72f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828750:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d72f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828802:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828811:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828819:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828825:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.828830:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828839:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828848:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.828851:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.828864:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828870:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d71a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.828883:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000eeb86e2 reply state 00000000c2ff5a2c transno 8589951065 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.828889:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580318.828915:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d713 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eefd expref: 385 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828926:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d72f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eefd expref: 384 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.828932:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:2.0:1777580318.828934:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580318.828936:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680e600, rc 0) 00000100:00100000:2.0:1777580318.828968:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+385:283502:x1863919946798336:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1169us (7921us total) trans 8589951065 rc 0/0 00000100:00100000:2.0:1777580318.828974:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19920 00000100:00100000:2.0:1777580318.828979:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776752197 time 7839776768655 state 0x2 ref 0 00000100:00100000:0.0:1777580318.875621:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875679:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875696:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875719:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875756:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875813:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580318.875852:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946798976 00000100:00100000:0.0:1777580318.875864:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946798976 00000100:00100000:0.0:1777580318.875916:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776752197 time 7839776768655 state 0x0 ref 1 00000100:00100000:0.0:1777580318.875932:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776868655 time 7839776768655 state 0x1 ref 1 00000100:00100000:0.0:1777580318.875947:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799232 00000100:00100000:0.0:1777580318.875949:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799232 00000100:00100000:0.0:1777580318.875959:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839576905882 time 7839606389071 state 0x0 ref 1 00000100:00100000:0.0:1777580318.875966:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 1 00000100:00100000:0.0:1777580318.875972:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799360 00000100:00100000:0.0:1777580318.875974:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799360 00000100:00100000:0.0:1777580318.875983:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 2 00000100:00100000:0.0:1777580318.875990:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799488 00000100:00100000:0.0:1777580318.875992:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799488 00000100:00100000:0.0:1777580318.876001:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 3 00000100:00100000:0.0:1777580318.876007:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799616 00000100:00100000:0.0:1777580318.876009:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799616 00000100:00100000:0.0:1777580318.876041:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 4 00000100:00100000:0.0:1777580318.876049:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799744 00000100:00100000:0.0:1777580318.876052:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799744 00000100:00100000:0.0:1777580318.876061:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 5 00000100:00100000:0.0:1777580318.876067:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799872 00000100:00100000:0.0:1777580318.876069:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799872 00000100:00100000:0.0:1777580318.876077:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839606489071 time 7839606389071 state 0x1 ref 6 00000100:00100000:0.0:1777580318.876083:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800128 00000100:00100000:0.0:1777580318.876085:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800128 00000100:00100000:0.0:1777580318.876095:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839776868655 time 7839776768655 state 0x1 ref 2 00000100:00100000:0.0:1777580318.876108:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825070987 time 7839824970987 state 0x1 ref 6 00000100:00100000:0.0:1777580318.876120:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283508:x1863919946799232:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.876196:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.876236:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d73d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef0b expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876323:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876342:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876356:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876371:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876386:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876393:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876395:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876403:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876420:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876426:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.876431:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876439:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876452:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580318.876456:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.876460:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876466:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd600/0xcb2b2f2f7e4d728 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.876517:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825478697 time 7839825378697 state 0x1 ref 2 00000100:00100000:3.0:1777580318.876530:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283500:x1863919946798976:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580318.876538:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.876539:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876547:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876554:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876559:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d759 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef04 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.876587:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x819:0x0]: returning size 0 00000004:00200000:0.0:1777580318.876592:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1777580318.876595:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d759 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef04 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876606:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d759 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef04 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.876616:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876629:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876633:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580318.876635:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580318.876637:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876638:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32200, rc 0) 00010000:00010000:0.0:1777580318.876642:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876647:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876661:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.876663:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876668:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876674:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.876676:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.876678:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876683:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9000/0xcb2b2f2f7e4d744 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876695:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876701:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876705:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876710:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.876712:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876718:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.876723:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aef35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283500:x1863919946798976:12345-192.168.202.9@tcp:101:touch.500 Request processed in 197us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.876732:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19922 00010000:00010000:0.0:1777580318.876734:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02498f4a300) 00010000:00010000:0.0:1777580318.876736:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.876738:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876744:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9800/0xcb2b2f2f7e4d74b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.876777:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825731778 time 7839825631778 state 0x1 ref 6 00010000:00010000:0.0:1777580318.876785:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8c00/0xcb2b2f2f7e4d73d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef0b expref: 393 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580318.876787:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283510:x1863919946799360:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.876795:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.876798:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef0b expref: 392 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876803:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d760 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef12 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876805:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:0.0:1777580318.876807:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.876810:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023af4c9200, rc 0) 00000100:00100000:0.0:1777580318.876831:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283508:x1863919946799232:12345-192.168.202.9@tcp:101:rm.500 Request processed in 714us (1151us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580318.876834:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.876838:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19923 00010000:00010000:3.0:1777580318.876843:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876850:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876863:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.876867:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825478697 time 7839825729327 state 0x0 ref 1 00010000:00010000:3.0:1777580318.876871:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.876875:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283502:x1863919946800128:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580318.876888:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876924:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580318.876938:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d72f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eefd expref: 392 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876941:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876949:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876957:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.876960:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02487fb4f00) 00010000:00010000:0.0:1777580318.876968:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1777580318.876976:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81a:0x0]: returning size 0 00000004:00200000:3.0:1777580318.876979:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580318.876989:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.876997:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877003:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877009:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877014:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877018:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.877021:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877029:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877033:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877036:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877041:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.877043:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.877043:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877046:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877051:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d767 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877060:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877064:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877069:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877073:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02389020400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.877075:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877080:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877085:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa024996f9800) 00010000:00010000:3.0:1777580318.877087:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.877089:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877099:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020400/0xcb2b2f2f7e4d76e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.877127:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c33600/0xcb2b2f2f7e4d760 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef12 expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.877219:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009a4eb49a reply state 0000000068d27c65 transno 8589951066 ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.877229:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.877275:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283502:x1863919946800128:12345-192.168.202.9@tcp:36:touch.500 Request processed in 400us (1460us total) trans 8589951066 rc 0/0 00000100:00100000:0.0:1777580318.877281:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19929 00000100:00100000:0.0:1777580318.877285:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825478697 time 7839825729327 state 0x2 ref 0 00000100:00100000:0.0:1777580318.877305:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839826269212 time 7839826169212 state 0x1 ref 5 00000100:00100000:0.0:1777580318.877313:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283503:x1863919946799488:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.877321:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.877331:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d783 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef19 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877361:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877376:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877383:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877395:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877401:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877406:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877460:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877469:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877476:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.877495:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x815:0x0]: returning size 0 00000004:00200000:0.0:1777580318.877497:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.877507:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877515:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877533:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877539:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877545:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877551:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.877554:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877561:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877569:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.877572:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.877574:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877581:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4d78a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877592:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877598:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877604:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877615:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.877619:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877625:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877634:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02498f4ad00) 00010000:00010000:0.0:1777580318.877636:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.877639:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877644:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4d791 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877670:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4d783 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef19 expref: 395 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877681:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef19 expref: 394 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877689:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:0.0:1777580318.877691:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.877694:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bd800, rc 0) 00000100:00100000:0.0:1777580318.877716:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283503:x1863919946799488:12345-192.168.202.9@tcp:101:rm.500 Request processed in 403us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.877724:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19925 00000100:00100000:0.0:1777580318.877742:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839826705427 time 7839826605427 state 0x1 ref 4 00000100:00100000:0.0:1777580318.877759:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283506:x1863919946799616:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580318.877780:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580318.877789:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d79f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef20 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877823:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877831:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877838:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877849:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877855:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877862:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877912:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877922:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877930:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580318.877960:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x817:0x0]: returning size 0 00000004:00200000:0.0:1777580318.877963:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580318.877973:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877981:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877987:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877992:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.877998:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878003:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.878005:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878011:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878019:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580318.878021:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.878024:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878029:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4d7a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878053:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878059:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878065:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878070:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580318.878073:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.878079:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878313:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef12 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878322:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa0241785f800) 00010000:00010000:3.0:1777580318.878325:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.878327:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02389020800, rc 0) 00000100:00100000:3.0:1777580318.878372:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283510:x1863919946799360:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1584us (2673us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.878379:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19924 00000100:00100000:3.0:1777580318.878401:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839827363909 time 7839827263909 state 0x1 ref 3 00000100:00100000:3.0:1777580318.878413:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283509:x1863919946799744:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.878423:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.878432:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d7bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef27 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878465:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878474:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878699:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878715:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878723:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878729:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878908:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878917:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878924:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580318.878947:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x818:0x0]: returning size 0 00000004:00200000:3.0:1777580318.878951:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580318.878964:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878973:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878981:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.878999:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879005:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879011:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.879014:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879020:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879030:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.879032:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.879036:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879042:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b800/0xcb2b2f2f7e4d7c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879058:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879064:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879071:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879077:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02395f9ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.879085:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879092:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879099:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02481358500) 00010000:00010000:3.0:1777580318.879102:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.879105:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879111:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9ae00/0xcb2b2f2f7e4d7c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879180:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021a00/0xcb2b2f2f7e4d7bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef27 expref: 394 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879195:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef27 expref: 393 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.879202:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580318.879205:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.879208:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02395f9bc00, rc 0) 00000100:00100000:3.0:1777580318.879249:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283509:x1863919946799744:12345-192.168.202.9@tcp:101:rm.500 Request processed in 838us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.879257:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19927 00000100:00100000:3.0:1777580318.879288:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839827363909 time 7839828150226 state 0x0 ref 2 00000100:00100000:3.0:1777580318.879302:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283511:x1863919946799872:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580318.879325:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580318.879337:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d7d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef2e expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882495:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882518:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882526:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882551:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.882557:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882565:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882585:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580318.882588:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.882593:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.882600:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d721 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.883092:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa0248a60e600) 00010000:00010000:0.0:1777580318.883096:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580318.883100:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.883109:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4d7ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.883354:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4d79f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef20 expref: 393 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.883375:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef20 expref: 392 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.883401:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:0.0:1777580318.883404:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580318.883407:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8800, rc 0) 00000100:00100000:0.0:1777580318.883510:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283506:x1863919946799616:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5749us (7767us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580318.883522:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19926 00010000:00010000:3.0:1777580318.900177:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900213:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900230:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900264:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900271:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900278:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900845:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900857:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900865:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580318.900907:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81b:0x0]: returning size 0 00000004:00200000:3.0:1777580318.900918:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580318.900946:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900960:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900969:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900976:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900983:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.900990:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b638e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.900994:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901002:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901014:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580318.901018:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.901023:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901030:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e600/0xcb2b2f2f7e4d7de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901044:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901058:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901063:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901068:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580318.901071:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901076:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901083:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024993dfe00) 00010000:00010000:3.0:1777580318.901085:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580318.901088:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901094:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d7e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901696:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b638e400/0xcb2b2f2f7e4d7d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef2e expref: 392 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901717:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef2e expref: 391 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580318.901725:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa02498f4a100) 00010000:00010000:3.0:1777580318.901728:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580318.901816:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7a00, rc 0) 00000100:00100000:3.0:1777580318.901927:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283511:x1863919946799872:12345-192.168.202.9@tcp:101:rm.500 Request processed in 22627us (26136us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580318.901939:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19928 00000100:00100000:3.0:1777580318.901949:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839827363909 time 7839828150226 state 0x2 ref 0 00000100:00100000:3.0:1777580318.902015:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946799104 00000100:00100000:3.0:1777580318.902026:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946799104 00000100:00100000:3.0:1777580318.902079:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12172 00000100:00100000:3.0:1777580318.902089:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+26:2363:x1863919946799104:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580318.902886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.906248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.906293:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.906319:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.906341:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580318.907234:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+27:2363:x1863919946799104:12345-192.168.202.9@tcp:2:touch.500 Request processed in 5139us (31566us total) trans 8589939091 rc 0/0 00000100:00100000:3.0:1777580318.907248:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12172 00000100:00100000:3.0:1777580318.909301:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800640 00000100:00100000:3.0:1777580318.909319:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800640 00000100:00100000:2.0:1777580318.909352:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800256 00000100:00100000:2.0:1777580318.909357:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800256 00000100:00100000:3.0:1777580318.909420:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800768 00000100:00100000:3.0:1777580318.909424:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800768 00000100:00100000:1.0:1777580318.909548:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.909588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.909609:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.909637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.909691:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800512 00000100:00100000:1.0:1777580318.909696:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800512 00000100:00100000:1.0:1777580318.909729:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825478697 time 7839825729327 state 0x0 ref 1 00000100:00100000:1.0:1777580318.909744:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825829327 time 7839825729327 state 0x1 ref 1 00000100:00100000:1.0:1777580318.909764:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946801408 00000100:00100000:1.0:1777580318.909789:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946801408 00000100:00100000:1.0:1777580318.909804:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839825829327 time 7839825729327 state 0x1 ref 2 00000100:00100000:1.0:1777580318.909827:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839858789646 time 7839858689646 state 0x1 ref 2 00000100:00100000:1.0:1777580318.909839:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283502:x1863919946800512:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.909865:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.909891:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d7f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef43 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.909976:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef43 expref: 393 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.909995:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef43 expref: 393 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910022:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:1.0:1777580318.910026:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.910030:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbda00, rc 0) 00000100:00100000:1.0:1777580318.910104:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283502:x1863919946800512:12345-192.168.202.9@tcp:101:touch.500 Request processed in 266us (7222us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.910112:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19930 00000100:00100000:1.0:1777580318.910244:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839858789646 time 7839859105754 state 0x0 ref 1 00000100:00100000:1.0:1777580318.910255:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283505:x1863919946801408:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.910269:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.910280:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d7fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef66 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910491:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910503:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910513:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910530:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910536:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.910541:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580318.911177:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15da:0x0], index 1: 0 00010000:00010000:1.0:1777580318.911389:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d80f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911402:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d80f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911411:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d80f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911454:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911475:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911483:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911490:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbc400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580318.911495:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911502:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911516:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580318.911519:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580318.911524:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911529:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc400/0xcb2b2f2f7e4d801 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580318.911542:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b6f9b0a6 reply state 00000000fab13f3c transno 8589951067 ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.911551:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580318.911594:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd800/0xcb2b2f2f7e4d7fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef66 expref: 395 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911609:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d80f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef66 expref: 394 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.911628:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa02499479900) 00010000:00010000:1.0:1777580318.911630:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580318.911632:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc600, rc 0) 00000100:00100000:1.0:1777580318.911704:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283505:x1863919946801408:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1450us (2064us total) trans 8589951067 rc 0/0 00000100:00100000:1.0:1777580318.911714:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19931 00000100:00100000:1.0:1777580318.911722:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839858789646 time 7839859105754 state 0x2 ref 0 00000100:00100000:1.0:1777580318.912919:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800384 00000100:00100000:1.0:1777580318.912931:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800384 00000100:00100000:3.0:1777580318.916105:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946800896 00000100:00100000:3.0:1777580318.916126:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946800896 00000100:00100000:1.0:1777580318.922002:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946801024 00000100:00100000:1.0:1777580318.922022:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946801024 00000100:00100000:1.0:1777580318.922082:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946801152 00000100:00100000:1.0:1777580318.922085:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946801152 00000100:00100000:1.0:1777580318.922114:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12173 00000100:00100000:1.0:1777580318.922125:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2363:x1863919946800640:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.922163:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.922197:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef4a expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.922237:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15f9:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.922262:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.922264:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1777580318.922271:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12174 00010000:00010000:1.0:1777580318.922275:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.922283:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+29:2361:x1863919946800768:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580318.922321:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.922336:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbdc00, rc 0) 00000100:00100000:1.0:1777580318.922941:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2363:x1863919946800640:12345-192.168.202.9@tcp:101:rm.500 Request processed in 812us (16702us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.922951:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12173 00000100:00100000:1.0:1777580318.922990:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12175 00000100:00100000:1.0:1777580318.923001:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946800256:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.923012:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.923032:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef35 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.923052:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15fb:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.923066:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923068:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923074:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923089:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923100:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbc200, rc 0) 00000100:00100000:1.0:1777580318.923124:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946800256:12345-192.168.202.9@tcp:101:rm.500 Request processed in 127us (16830us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.923184:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12175 00000100:00100000:1.0:1777580318.923204:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12176 00000100:00100000:1.0:1777580318.923211:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946800896:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.923219:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.923236:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef51 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.923251:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d6:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.923261:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923263:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923267:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923279:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923287:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02404cbcc00, rc 0) 00000100:00100000:1.0:1777580318.923308:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946800896:12345-192.168.202.9@tcp:101:rm.500 Request processed in 98us (13768us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.923314:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12176 00000100:00100000:1.0:1777580318.923328:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12177 00000100:00100000:1.0:1777580318.923334:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946800384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.923342:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.923482:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef3c expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.923505:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d7:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.923516:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923518:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923523:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923533:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923540:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384c32a00, rc 0) 00000100:00100000:1.0:1777580318.923670:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946800384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 335us (17327us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.923675:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12177 00000100:00100000:1.0:1777580318.923696:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12178 00000100:00100000:1.0:1777580318.923703:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946801024:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.923711:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.923724:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef58 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.923865:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15fa:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.923878:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923879:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.923885:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923925:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.923936:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb2800, rc 0) 00000100:00100000:1.0:1777580318.923963:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2362:x1863919946801024:12345-192.168.202.9@tcp:101:rm.500 Request processed in 260us (14374us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.923968:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12178 00000100:00100000:1.0:1777580318.923984:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12179 00000100:00100000:1.0:1777580318.923991:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946801152:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580318.923999:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580318.924009:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef5f expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580318.924023:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15fc:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580318.924031:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.924033:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580318.924037:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.924048:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 31 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.924057:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02392cb3e00, rc 0) 00000100:00100000:1.0:1777580318.924077:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946801152:12345-192.168.202.9@tcp:101:rm.500 Request processed in 87us (14467us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.924090:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12179 00000100:00100000:1.0:1777580318.924258:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.928289:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2361:x1863919946800768:12345-192.168.202.9@tcp:2:touch.500 Request processed in 5993us (21952us total) trans 8589938691 rc 0/0 00000100:00100000:2.0:1777580318.928308:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12174 00000100:00100000:2.0:1777580318.928399:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946801664 00000100:00100000:2.0:1777580318.928411:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946801664 00000100:00100000:2.0:1777580318.928475:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4264 00000100:00100000:2.0:1777580318.928484:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283498:x1863919946801664:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580318.928937:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283498:x1863919946801664:12345-192.168.202.9@tcp:35:touch.500 Request processed in 452us (4678us total) trans 8589951068 rc 0/0 00000100:00100000:2.0:1777580318.928963:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4264 00010000:00010000:2.0:1777580318.930533:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930552:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930561:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930566:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023af4c8400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.930572:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930580:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930600:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:2.0:1777580318.930603:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.930608:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.930614:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c8400/0xcb2b2f2f7e4d77c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.948360:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.948407:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580318.948844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.948888:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948930:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948939:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948947:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02404cbd200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.948954:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948963:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948983:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02499479b00) 00010000:00010000:2.0:1777580318.948986:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.948992:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.948998:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd200/0xcb2b2f2f7e4d808 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.949056:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946802048 00000100:00100000:2.0:1777580318.949068:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946802048 00000100:00100000:2.0:1777580318.953068:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839858789646 time 7839859105754 state 0x0 ref 1 00000100:00100000:2.0:1777580318.953102:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839859205754 time 7839859105754 state 0x1 ref 1 00000100:00100000:2.0:1777580318.953669:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946802304 00000100:00100000:2.0:1777580318.953684:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946802304 00000100:00100000:2.0:1777580318.953726:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839827363909 time 7839828150226 state 0x0 ref 1 00000100:00100000:2.0:1777580318.953754:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839828250226 time 7839828150226 state 0x1 ref 1 00000100:00100000:2.0:1777580318.953794:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839828250226 time 7839902655658 state 0x0 ref 1 00000100:00100000:2.0:1777580318.953812:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283509:x1863919946802304:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580318.953893:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580318.953926:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9bc00/0xcb2b2f2f7e4d7d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x818:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef27 expref: 395 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.953954:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389021200/0xcb2b2f2f7e4d51b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x818:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee6a expref: 394 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.953965:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580318.953978:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580318.954008:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.954026:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.954037:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.954053:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.954060:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.954066:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.954999:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839859205754 time 7839903856301 state 0x0 ref 1 00000100:00100000:0.0:1777580318.955028:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283505:x1863919946802048:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580318.955079:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580318.955115:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc600/0xcb2b2f2f7e4d80f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef66 expref: 393 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.955149:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa02499479900) 00010000:00010000:0.0:1777580318.955160:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580318.955252:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.955264:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580318.955272:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580318.955487:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000017aeaf7c reply state 00000000c8ac6652 transno 8589951069 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.955516:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580318.955690:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283505:x1863919946802048:12345-192.168.202.9@tcp:36:touch.500 Request processed in 671us (7281us total) trans 8589951069 rc 0/0 00000100:00100000:0.0:1777580318.955700:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19932 00000100:00100000:0.0:1777580318.955706:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839859205754 time 7839903856301 state 0x2 ref 0 00000100:00100000:3.0:1777580318.955923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580318.956911:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.956929:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.956942:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580318.957245:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946801792 00000100:00100000:0.0:1777580318.957258:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946801792 00000100:00100000:0.0:1777580318.958216:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12180 00000100:00100000:0.0:1777580318.958232:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2361:x1863919946801792:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580318.958698:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946801792:12345-192.168.202.9@tcp:2:touch.500 Request processed in 470us (10625us total) trans 8589939092 rc 0/0 00000100:00100000:0.0:1777580318.958707:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12180 00000100:00100000:1.0:1777580318.963680:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946802560 00000100:00100000:1.0:1777580318.963697:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946802560 00000100:00100000:1.0:1777580318.963780:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4265 00000100:00100000:1.0:1777580318.963792:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283500:x1863919946802560:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580318.964323:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283500:x1863919946802560:12345-192.168.202.9@tcp:35:touch.500 Request processed in 530us (8398us total) trans 8589951070 rc 0/0 00000100:00100000:1.0:1777580318.964332:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4265 00000040:00080000:2.0:1777580318.965834:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1906, 64 off130176 00010000:00010000:2.0:1777580318.965976:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.965999:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966016:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966025:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966031:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966038:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966058:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580318.966086:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966104:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966111:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966117:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.966123:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.966131:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970017:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa02488b77a00) 00010000:00010000:2.0:1777580318.970020:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580318.970031:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970041:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d85c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x818:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970077:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970085:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970092:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970098:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.970112:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970121:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970723:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580318.970728:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.970733:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.970743:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d847 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580318.970759:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c078c8bc reply state 0000000026490056 transno 8589951071 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.970776:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580318.970910:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283509:x1863919946802304:12345-192.168.202.9@tcp:36:rm.500 Request processed in 17097us (22059us total) trans 8589951071 rc 0/0 00000100:00100000:2.0:1777580318.970921:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19933 00000100:00100000:2.0:1777580318.970931:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839828250226 time 7839902655658 state 0x2 ref 0 00010000:00010000:2.0:1777580318.978428:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580318.978448:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.978463:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580318.978468:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.978478:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.978536:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x818:0x0].0x0 (ffffa02488b77a00) 00010000:00010000:2.0:1777580318.978539:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580318.978545:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.978552:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d863 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x818:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.978577:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.978580:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.978582:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580318.979479:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979557:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979565:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979570:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580318.979576:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979583:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979597:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa0248a60ea00) 00010000:00010000:2.0:1777580318.979601:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580318.979605:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580318.979627:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4d855 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580318.979979:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.981292:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580318.981647:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946802688 00000100:00100000:1.0:1777580318.981659:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946802688 00000100:00100000:1.0:1777580318.981705:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839859205754 time 7839903856301 state 0x0 ref 1 00000100:00100000:1.0:1777580318.981720:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839903956301 time 7839903856301 state 0x1 ref 1 00000100:00100000:1.0:1777580318.982479:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839903956301 time 7839931336794 state 0x0 ref 1 00000100:00100000:1.0:1777580318.982502:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283505:x1863919946802688:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580318.982535:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1777580318.982619:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946802944 00000100:00100000:2.0:1777580318.982626:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946802944 00000100:00100000:2.0:1777580318.982674:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4266 00000100:00100000:2.0:1777580318.982681:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283502:x1863919946802944:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580318.983275:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4d86a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef6d expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.983338:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4d86a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x820:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef6d expref: 398 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580318.983342:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283502:x1863919946802944:12345-192.168.202.9@tcp:35:touch.500 Request processed in 661us (2056us total) trans 8589951072 rc 0/0 00000100:00100000:2.0:1777580318.983351:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4266 00010000:00010000:1.0:1777580318.983730:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4d86a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x820:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef6d expref: 397 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580318.983857:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa0249dea8500) 00010000:00010000:1.0:1777580318.983860:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777580318.983865:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b800, rc 0) 00000100:00100000:1.0:1777580318.983897:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283505:x1863919946802688:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1403us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580318.983906:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19934 00000100:00100000:1.0:1777580318.983913:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839903956301 time 7839931336794 state 0x2 ref 0 00000100:00100000:2.0:1777580319.004824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.004879:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946803200 00000100:00100000:2.0:1777580319.004893:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946803200 00000100:00100000:2.0:1777580319.004947:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839828250226 time 7839902655658 state 0x0 ref 1 00000100:00100000:2.0:1777580319.004963:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839902755658 time 7839902655658 state 0x1 ref 1 00000100:00100000:2.0:1777580319.004990:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839902755658 time 7839953852750 state 0x0 ref 1 00000100:00100000:2.0:1777580319.005002:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283486:x1863919946803200:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580319.005224:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005238:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005246:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005252:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.005257:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005265:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005316:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02488b77500) 00010000:00010000:0.0:1777580319.005321:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.005327:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.005334:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d84e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006274:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.006311:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d55a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x812:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee7f expref: 396 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006334:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b600/0xcb2b2f2f7e4d26d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x812:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edec expref: 395 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006635:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa024993df900) 00010000:00010000:2.0:1777580319.006645:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.006679:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006695:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006707:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006721:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006728:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.006734:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.007471:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.007935:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946803328 00000100:00100000:1.0:1777580319.007953:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946803328 00000100:00100000:1.0:1777580319.008074:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12181 00000100:00100000:1.0:1777580319.008100:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+30:2362:x1863919946803328:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580319.008628:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+31:2362:x1863919946803328:12345-192.168.202.9@tcp:2:touch.500 Request processed in 541us (1160us total) trans 8589938692 rc 0/0 00000100:00100000:1.0:1777580319.008639:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12181 00010000:00010000:2.0:1777580319.010219:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.010242:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.010257:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.016383:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000040:00080000:2.0:1777580319.018573:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1907, 64 off130240 00010000:00010000:2.0:1777580319.018685:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018723:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018739:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018750:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018757:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018763:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018793:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.018822:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018828:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018835:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018841:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.018846:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018853:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018877:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa02488b77200) 00010000:00010000:2.0:1777580319.018880:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.018886:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018892:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d87f lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x812:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018918:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018925:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018930:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018936:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.018939:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018945:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018952:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.018955:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.018958:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.018963:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d871 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.018985:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001f09cc81 reply state 00000000448ccb89 transno 8589951073 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.018998:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.019164:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283486:x1863919946803200:12345-192.168.202.9@tcp:36:rm.500 Request processed in 14128us (14398us total) trans 8589951073 rc 0/0 00000100:00100000:2.0:1777580319.019175:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19935 00000100:00100000:2.0:1777580319.019185:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839902755658 time 7839953852750 state 0x2 ref 0 00010000:00010000:0.0:1777580319.020781:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580319.020797:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.020811:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580319.020816:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.020826:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.020845:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x812:0x0].0x0 (ffffa02488b77200) 00010000:00010000:0.0:1777580319.020848:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580319.020853:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.020860:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d886 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x812:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.020886:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.020888:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.020890:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580319.022722:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946803584 00000100:00100000:2.0:1777580319.023619:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946803584 00000100:00100000:2.0:1777580319.023721:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4267 00000100:00100000:2.0:1777580319.023733:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283505:x1863919946803584:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.026818:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283505:x1863919946803584:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3073us (10434us total) trans 8589951074 rc 0/0 00000100:00100000:2.0:1777580319.026834:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4267 00010000:00010000:2.0:1777580319.028333:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028351:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028359:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028365:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.028371:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028393:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028414:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02488b77a00) 00010000:00010000:2.0:1777580319.028417:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.028423:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.028429:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d878 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.028794:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.029222:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946803840 00000100:00100000:2.0:1777580319.029235:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946803840 00000100:00100000:2.0:1777580319.029287:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839902755658 time 7839953852750 state 0x0 ref 1 00000100:00100000:2.0:1777580319.031172:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839953952750 time 7839953852750 state 0x1 ref 1 00000100:00100000:2.0:1777580319.031231:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839953952750 time 7839980092195 state 0x0 ref 1 00000100:00100000:2.0:1777580319.031263:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283492:x1863919946803840:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.032908:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.032954:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d592 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x814:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee8d expref: 396 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.032980:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbd400/0xcb2b2f2f7e4d33f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x814:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee1d expref: 395 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.032993:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:2.0:1777580319.033021:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.033053:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.033069:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.033081:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035187:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035208:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035221:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035707:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035718:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.035727:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.039468:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1908, 64 off130304 00010000:00010000:2.0:1777580319.039586:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039609:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039634:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039644:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039651:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039658:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039682:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.039713:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.039720:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039728:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.039733:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039741:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039755:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580319.039758:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.039764:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039780:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x814:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039808:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.039810:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.039811:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.039854:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039861:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039868:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039873:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.039877:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039884:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039891:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x814:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580319.039894:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.039897:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039902:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d89b lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x814:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039925:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039931:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039942:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039948:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.039950:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039956:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039963:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.039965:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.039968:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.039973:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d88d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.039983:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004e76a1a4 reply state 000000003682b737 transno 8589951075 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.039992:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.040126:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023864a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283492:x1863919946803840:12345-192.168.202.9@tcp:36:rm.500 Request processed in 8875us (11332us total) trans 8589951075 rc 0/0 00000100:00100000:2.0:1777580319.040172:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19936 00000100:00100000:2.0:1777580319.040182:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839953952750 time 7839980092195 state 0x2 ref 0 00000100:00100000:3.0:1777580319.066519:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.066546:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066573:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066582:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066589:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.066594:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066603:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066626:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02488b77200) 00010000:00010000:0.0:1777580319.066630:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.066635:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.066641:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d894 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.081497:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804096 00000100:00100000:1.0:1777580319.081521:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804096 00000100:00100000:1.0:1777580319.081950:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839953952750 time 7839980092195 state 0x0 ref 1 00000100:00100000:1.0:1777580319.081967:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839980192195 time 7839980092195 state 0x1 ref 1 00000100:00100000:1.0:1777580319.081998:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839980192195 time 7840030860606 state 0x0 ref 1 00000100:00100000:1.0:1777580319.082035:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283484:x1863919946804096:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580319.082125:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580319.082650:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d537 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x811:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee71 expref: 395 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082680:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbce00/0xcb2b2f2f7e4d219 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x811:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edde expref: 394 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082691:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa024993df600) 00010000:00010000:1.0:1777580319.082703:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580319.082733:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082752:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082764:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082792:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082801:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082808:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082974:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082991:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.082998:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580319.084989:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1911, 64 off130496 00000004:00080000:1.0:1777580319.085009:0:187632:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7840033873792ns, next at 7841033870357ns, rc = 0 00010000:00010000:1.0:1777580319.085111:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.085168:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.085182:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.085191:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.085198:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.085205:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090791:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580319.090848:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090861:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090878:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090885:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.090890:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090898:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090917:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa02427669600) 00010000:00010000:1.0:1777580319.090921:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580319.090926:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090932:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d8b7 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x811:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090958:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090964:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090969:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090974:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.090976:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090991:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.090999:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580319.091001:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.091004:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.091009:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d8a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580319.091019:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000adf894db reply state 000000000fff69cc transno 8589951076 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.091029:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580319.091261:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580319.091269:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.091276:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8aa00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580319.091280:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.091297:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.091307:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x811:0x0].0x0 (ffffa02427669600) 00010000:00010000:0.0:1777580319.091309:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580319.091312:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.091318:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4d8be lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x811:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.091338:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.091340:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.091341:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580319.092298:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283484:x1863919946804096:12345-192.168.202.9@tcp:36:rm.500 Request processed in 10262us (25784us total) trans 8589951076 rc 0/0 00000100:00100000:1.0:1777580319.092313:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19937 00000100:00100000:1.0:1777580319.092323:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839980192195 time 7840030860606 state 0x2 ref 0 00010000:00010000:2.0:1777580319.095228:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095275:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095284:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095290:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.095296:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095304:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095325:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0249dea8c00) 00010000:00010000:2.0:1777580319.095328:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.095334:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.095340:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4d8b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.100685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.103702:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804352 00000100:00100000:2.0:1777580319.103722:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804352 00000100:00100000:2.0:1777580319.103798:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839980192195 time 7840030860606 state 0x0 ref 1 00000100:00100000:2.0:1777580319.103815:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840030960606 time 7840030860606 state 0x1 ref 1 00000100:00100000:2.0:1777580319.103847:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840030960606 time 7840052709005 state 0x0 ref 1 00000100:00100000:2.0:1777580319.103866:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283504:x1863919946804352:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.103955:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.103991:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4d5ae lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x816:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee94 expref: 394 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104018:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32400/0xcb2b2f2f7e4d47a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x816:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee4e expref: 393 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104030:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa024993df500) 00010000:00010000:2.0:1777580319.104044:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.104074:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104262:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104277:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104306:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104315:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104321:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104609:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104620:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.104639:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.105992:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1909, 64 off130368 00010000:00010000:2.0:1777580319.106469:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106492:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106506:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106516:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106524:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106531:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106555:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.106588:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106593:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106599:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106622:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.106628:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106636:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106650:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa02488b77a00) 00010000:00010000:2.0:1777580319.106653:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.106659:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106666:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f000/0xcb2b2f2f7e4d8d3 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x816:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106689:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106696:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106701:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106706:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.106709:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106714:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.106733:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.106735:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.107011:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107019:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4d8c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.107032:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ecdfe1d2 reply state 00000000e68d9d2d transno 8589951077 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.107043:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.107208:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283504:x1863919946804352:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3344us (6533us total) trans 8589951077 rc 0/0 00000100:00100000:2.0:1777580319.107220:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19938 00000100:00100000:2.0:1777580319.107229:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840030960606 time 7840052709005 state 0x2 ref 0 00010000:00010000:2.0:1777580319.107294:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.107301:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107308:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.107313:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107321:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107331:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x816:0x0].0x0 (ffffa02488b77a00) 00010000:00010000:2.0:1777580319.107333:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.107420:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107428:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f800/0xcb2b2f2f7e4d8da lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x816:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.107444:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.107446:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.107448:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580319.113038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.113073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.115119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.115191:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.115220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.115514:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.115530:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.115539:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.115542:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804480 00010000:00010000:0.0:1777580319.115554:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:2.0:1777580319.115556:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804480 00010000:00010000:0.0:1777580319.115561:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.115569:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.115588:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02488b77500) 00010000:00010000:0.0:1777580319.115598:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777580319.115602:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840030960606 time 7840052709005 state 0x0 ref 1 00010000:00010000:0.0:1777580319.115604:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.115611:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d8cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.115657:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840052809005 time 7840052709005 state 0x1 ref 1 00000100:00100000:2.0:1777580319.115691:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804608 00000100:00100000:2.0:1777580319.115695:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804608 00000100:00100000:2.0:1777580319.115708:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840052809005 time 7840052709005 state 0x1 ref 2 00000100:00100000:2.0:1777580319.115721:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804736 00000100:00100000:2.0:1777580319.115723:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804736 00000100:00100000:2.0:1777580319.115730:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840052809005 time 7840052709005 state 0x1 ref 3 00000100:00100000:2.0:1777580319.115741:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804864 00000100:00100000:2.0:1777580319.115743:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804864 00000100:00100000:2.0:1777580319.115751:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840052809005 time 7840052709005 state 0x1 ref 4 00000100:00100000:2.0:1777580319.115758:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946804992 00000100:00100000:2.0:1777580319.115760:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946804992 00000100:00100000:2.0:1777580319.115781:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840052809005 time 7840052709005 state 0x1 ref 5 00000100:00100000:2.0:1777580319.115795:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840064757352 time 7840064657352 state 0x1 ref 5 00000100:00100000:2.0:1777580319.115817:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283513:x1863919946804480:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.115847:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.115866:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d8e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef74 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115944:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115959:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115970:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115985:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115992:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.115999:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116165:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116174:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116181:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580319.116228:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81d:0x0]: returning size 0 00000004:00200000:2.0:1777580319.116232:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580319.116253:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116266:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116276:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116282:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116288:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116294:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.116297:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116303:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116310:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.116313:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.116316:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116328:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4d8e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116348:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116355:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116362:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116367:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.116369:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116375:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116381:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02488b77200) 00010000:00010000:2.0:1777580319.116384:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.116386:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116392:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4d8ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116422:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4d8e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef74 expref: 399 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116434:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef74 expref: 398 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116454:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580319.116457:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.116459:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fda00, rc 0) 00000100:00100000:2.0:1777580319.116532:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283513:x1863919946804480:12345-192.168.202.9@tcp:101:rm.500 Request processed in 718us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.116541:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19939 00000100:00100000:2.0:1777580319.116569:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065532487 time 7840065432487 state 0x1 ref 4 00000100:00100000:2.0:1777580319.116581:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283515:x1863919946804608:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.116590:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.116598:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d8fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef7b expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116630:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116639:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116647:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116659:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116666:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116684:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116741:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116749:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116755:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580319.116788:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81f:0x0]: returning size 0 00000004:00200000:2.0:1777580319.116791:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580319.116802:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116811:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116818:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116824:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116829:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116835:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.116837:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116850:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116858:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.116860:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.116862:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116867:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4d904 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116878:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.116880:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065841032 time 7840065741032 state 0x1 ref 4 00010000:00010000:2.0:1777580319.116884:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116890:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.116894:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283512:x1863919946804736:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.116895:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.116897:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116903:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.116904:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116911:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa0241785f300) 00010000:00010000:1.0:1777580319.116912:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d919 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef82 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116914:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.116916:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116930:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d90b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116945:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116952:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4d8fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef7b expref: 400 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116960:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116963:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef7b expref: 399 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116968:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.116970:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:2.0:1777580319.116972:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.116975:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00010000:00010000:1.0:1777580319.116979:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116985:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.116991:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.116997:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:283515:x1863919946804608:12345-192.168.202.9@tcp:101:rm.500 Request processed in 420us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.117003:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19940 00000100:00100000:2.0:1777580319.117019:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065982615 time 7840065882615 state 0x1 ref 3 00000100:00100000:2.0:1777580319.117028:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283516:x1863919946804864:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.117036:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.117043:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d935 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef89 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117043:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117051:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117058:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580319.117076:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81c:0x0]: returning size 0 00000004:00200000:1.0:1777580319.117079:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580319.117087:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117088:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117095:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117096:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117114:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117115:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117121:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117126:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117127:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117150:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117157:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117161:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.117164:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117170:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117178:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580319.117181:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.117183:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117189:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4d920 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117198:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117203:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117205:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117211:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117212:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117218:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117224:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.117227:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117231:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580319.117237:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x820:0x0]: returning size 0 00000004:00200000:2.0:1777580319.117239:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1777580319.117239:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02427669200) 00010000:00010000:1.0:1777580319.117242:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.117244:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.117248:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.117251:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4d927 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117255:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117261:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117276:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.117282:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.117354:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065982615 time 7840066215192 state 0x0 ref 3 00000100:00100000:3.0:1777580319.117370:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283514:x1863919946804992:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.117379:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.117389:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d951 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef90 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.117421:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.120330:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ba00/0xcb2b2f2f7e4d919 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef82 expref: 401 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.120379:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef82 expref: 400 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.120392:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02499479000) 00010000:00010000:1.0:1777580319.120395:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580319.120400:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:1.0:1777580319.120693:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+400:283512:x1863919946804736:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3799us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580319.120704:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19941 00010000:00010000:2.0:1777580319.123226:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.123244:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123261:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123437:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.123442:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.123450:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123458:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d93c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123479:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123486:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123494:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123499:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.123520:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123527:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123536:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024c6346a00) 00010000:00010000:2.0:1777580319.123538:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.123541:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123547:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d943 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123624:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d935 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef89 expref: 400 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123643:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef89 expref: 399 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.123651:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa0249dea8500) 00010000:00010000:2.0:1777580319.123653:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.123657:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4f800, rc 0) 00000100:00100000:2.0:1777580319.123883:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+399:283516:x1863919946804864:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6851us (8687us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.123894:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19942 00010000:00010000:3.0:1777580319.128928:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.128962:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129190:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129201:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129207:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129368:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129377:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129385:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580319.129441:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x81e:0x0]: returning size 0 00000004:00200000:3.0:1777580319.129446:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580319.129476:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129503:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129513:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129520:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129527:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129533:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.129537:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.129545:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130801:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.130805:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.130813:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130820:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4d958 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130973:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130982:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130989:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.130994:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.130998:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131004:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131012:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024993dfe00) 00010000:00010000:3.0:1777580319.131014:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.131017:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131023:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4d95f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131086:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4d951 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef90 expref: 399 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131103:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef90 expref: 398 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.131122:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580319.131125:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.131128:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7c00, rc 0) 00000100:00100000:3.0:1777580319.131247:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283514:x1863919946804992:12345-192.168.202.9@tcp:101:rm.500 Request processed in 13880us (16024us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.131258:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19943 00000100:00100000:3.0:1777580319.131267:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065982615 time 7840066215192 state 0x2 ref 0 00000100:00100000:3.0:1777580319.131388:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.131711:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805120 00000100:00100000:1.0:1777580319.131734:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805120 00000100:00100000:1.0:1777580319.131814:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12182 00000100:00100000:1.0:1777580319.131826:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946805120:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580319.131847:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580319.131875:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef97 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580319.131914:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15fd:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:1.0:1777580319.131937:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580319.131940:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580319.131951:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 33 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.131971:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 33 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.131984:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8ba00, rc 0) 00000100:00100000:1.0:1777580319.132033:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946805120:12345-192.168.202.9@tcp:101:rm.500 Request processed in 211us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580319.132040:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12182 00000100:00080000:1.0:1777580319.132081:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777580319.133000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.133071:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.133099:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.133466:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805248 00000100:00100000:3.0:1777580319.133477:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805248 00000100:00100000:3.0:1777580319.133541:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805376 00000100:00100000:3.0:1777580319.133544:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805376 00000100:00100000:2.0:1777580319.133624:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805504 00000100:00100000:2.0:1777580319.133629:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805504 00000100:00100000:2.0:1777580319.133662:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12183 00000100:00100000:2.0:1777580319.133673:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946805248:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.133705:0:207637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.133733:0:207637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90ef9e expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580319.133785:0:207637:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d8:0x0] initial LVB size: 0, mtime: 0x69f3b91d, atime: 0x69f3b91d, ctime: 0x69f3b91d, blocks: 0x1 00010000:00010000:2.0:1777580319.133808:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.133811:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.133819:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 33 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.133840:0:207637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 33 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.133855:0:207637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4f200, rc 0) 00000100:00100000:2.0:1777580319.133918:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946805248:12345-192.168.202.9@tcp:101:rm.500 Request processed in 248us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.133925:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12183 00000100:00100000:2.0:1777580319.133951:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12184 00000100:00100000:2.0:1777580319.133957:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+32:2361:x1863919946805504:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.133964:0:207637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.133975:0:207637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efac expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580319.133988:0:207637:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15da:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:2.0:1777580319.133996:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.134004:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.134009:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 33 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.134021:0:207637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 33 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.134030:0:207637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f800, rc 0) 00000100:00100000:2.0:1777580319.134051:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946805504:12345-192.168.202.9@tcp:101:rm.500 Request processed in 94us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.134057:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12184 00000100:00100000:3.0:1777580319.140401:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12185 00000100:00100000:3.0:1777580319.140417:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946805376:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.140445:0:188248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.140475:0:188248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efa5 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.140509:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.140613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.140647:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805632 00000100:00100000:2.0:1777580319.140658:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805632 00000100:00100000:2.0:1777580319.140688:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12186 00000100:00100000:2.0:1777580319.140695:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+33:2361:x1863919946805632:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.140704:0:188246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.140720:0:188246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efb3 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580319.140758:0:188246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15d9:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:2.0:1777580319.140792:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.140795:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.140805:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.140848:0:188246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 34 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.140863:0:188246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680f000, rc 0) 00000100:00100000:2.0:1777580319.140935:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2361:x1863919946805632:12345-192.168.202.9@tcp:101:rm.500 Request processed in 240us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.140944:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12186 00000100:00100000:2.0:1777580319.140982:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946805888 00000100:00100000:2.0:1777580319.140986:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946805888 00000100:00100000:2.0:1777580319.141009:0:187631:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840065982615 time 7840066215192 state 0x0 ref 1 00000100:00100000:2.0:1777580319.141021:0:187631:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840066315192 time 7840066215192 state 0x1 ref 1 00000100:00100000:2.0:1777580319.141041:0:187631:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840066315192 time 7840089902827 state 0x0 ref 1 00000100:00100000:2.0:1777580319.141049:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283508:x1863919946805888:12345-192.168.202.9@tcp:36:rm.500 00002000:00010000:3.0:1777580319.141285:0:188248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15fe:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:3.0:1777580319.141299:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580319.141301:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580319.141307:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 34 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.141332:0:188248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 34 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.141345:0:188248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb6800, rc 0) 00000100:00100000:3.0:1777580319.141371:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+34:2361:x1863919946805376:12345-192.168.202.9@tcp:101:rm.500 Request processed in 959us (8303us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.141378:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12185 00010000:00010000:2.0:1777580319.143176:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.143226:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023af4c9200/0xcb2b2f2f7e4d752 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x819:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef0b expref: 398 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143254:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d53e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x819:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee78 expref: 397 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143267:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580319.143279:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.143333:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143352:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143363:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143382:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143388:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143395:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143572:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143581:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.143588:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.154530:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1912, 64 off130560 00010000:00010000:2.0:1777580319.154638:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.154663:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.154690:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.154701:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.154708:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.154715:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155203:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.155237:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155247:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155254:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155261:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.155265:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155274:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155289:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:2.0:1777580319.155292:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.155307:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155315:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d99e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x819:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155340:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155357:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155364:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155369:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.155371:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155377:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155384:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.155387:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.155390:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.155396:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4d990 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.155406:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001eed836e reply state 00000000d2c58abe transno 8589951078 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.155426:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.155555:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+398:283508:x1863919946805888:12345-192.168.202.9@tcp:36:rm.500 Request processed in 14498us (14933us total) trans 8589951078 rc 0/0 00000100:00100000:2.0:1777580319.155566:0:187631:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19944 00000100:00100000:2.0:1777580319.155577:0:187631:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840066315192 time 7840089902827 state 0x2 ref 0 00010000:00010000:3.0:1777580319.155852:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580319.155861:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.155869:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580319.155872:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.155879:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.155890:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x819:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:3.0:1777580319.155893:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580319.155896:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.155902:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x819:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.155921:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.155922:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.155932:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.158748:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158782:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158791:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158797:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.158803:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158810:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158829:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa0249076fc00) 00010000:00010000:3.0:1777580319.158832:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.158838:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.158844:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4d997 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.170744:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.170816:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946806144 00000100:00100000:2.0:1777580319.170829:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946806144 00000100:00100000:2.0:1777580319.170877:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840066315192 time 7840089902827 state 0x0 ref 1 00000100:00100000:2.0:1777580319.170893:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840090002827 time 7840089902827 state 0x1 ref 1 00000100:00100000:2.0:1777580319.170921:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840090002827 time 7840119783510 state 0x0 ref 1 00000100:00100000:2.0:1777580319.170933:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283510:x1863919946806144:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.171008:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.171041:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02389020800/0xcb2b2f2f7e4d775 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef12 expref: 397 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171063:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4d641 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eecc expref: 396 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171074:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580319.171086:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.171114:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171167:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171179:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171197:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171205:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171211:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171361:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171369:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.171375:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.172012:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1910, 64 off130432 00010000:00010000:2.0:1777580319.172082:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172093:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172103:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172180:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172187:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172193:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172218:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.172244:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172250:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172257:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172264:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.172268:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172277:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172287:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:2.0:1777580319.172290:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.172295:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172313:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9ba lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172332:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172339:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172345:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172349:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.172353:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172359:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172368:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.172370:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.172373:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.172379:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.172387:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000040ac96e8 reply state 000000001e3d7ad4 transno 8589951079 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.172397:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.172520:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+397:283510:x1863919946806144:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1585us (1788us total) trans 8589951079 rc 0/0 00000100:00100000:2.0:1777580319.172530:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19945 00000100:00100000:2.0:1777580319.172538:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840090002827 time 7840119783510 state 0x2 ref 0 00010000:00010000:3.0:1777580319.172842:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580319.172849:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.172856:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580319.172860:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.172875:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.172885:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81a:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:3.0:1777580319.172887:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580319.172891:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.172896:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.172910:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.172912:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.172913:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580319.180834:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.181747:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181775:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181785:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181792:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.181799:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181806:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181826:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa0249076f700) 00010000:00010000:0.0:1777580319.181829:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.181835:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.181842:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4d9b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.184497:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946806400 00000100:00100000:2.0:1777580319.184517:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946806400 00000100:00100000:2.0:1777580319.184582:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840090002827 time 7840119783510 state 0x0 ref 1 00000100:00100000:2.0:1777580319.184598:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840119883510 time 7840119783510 state 0x1 ref 1 00000100:00100000:2.0:1777580319.184630:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840119883510 time 7840133492555 state 0x0 ref 1 00000100:00100000:2.0:1777580319.184648:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283503:x1863919946806400:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.184731:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.186521:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4d798 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x815:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef19 expref: 396 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186565:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbde00/0xcb2b2f2f7e4d457 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x815:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee47 expref: 395 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186579:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:2.0:1777580319.186594:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.186637:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186659:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186672:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186706:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186714:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.186720:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.188266:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.188285:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.188297:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.194494:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1913, 64 off130624 00010000:00010000:2.0:1777580319.194621:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194646:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194663:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194672:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194678:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194700:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.194723:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.195205:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195214:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195220:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195225:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.195230:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195238:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195252:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580319.195255:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.195260:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195267:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4d9d6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x815:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195291:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195309:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195315:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195320:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.195323:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195330:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.195338:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.195340:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.195343:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.196843:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4d9c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.196866:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000305d99d1 reply state 00000000f8e5ec0e transno 8589951080 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.196876:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.197026:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+396:283503:x1863919946806400:12345-192.168.202.9@tcp:36:rm.500 Request processed in 12376us (16203us total) trans 8589951080 rc 0/0 00000100:00100000:2.0:1777580319.197037:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19946 00000100:00100000:2.0:1777580319.197046:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840119883510 time 7840133492555 state 0x2 ref 0 00010000:00010000:2.0:1777580319.197166:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.197173:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.197182:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.197187:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.197195:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.197213:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x815:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580319.197216:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.197219:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.197226:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4d9dd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x815:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.197244:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.197246:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.197248:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.211820:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211845:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211854:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211861:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.211868:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211877:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211923:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024c6346a00) 00010000:00010000:3.0:1777580319.211926:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.211934:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.211940:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4d9cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.214211:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.215424:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946806656 00000100:00100000:3.0:1777580319.215443:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946806656 00000100:00100000:3.0:1777580319.215777:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840119883510 time 7840133492555 state 0x0 ref 1 00000100:00100000:3.0:1777580319.215795:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840133592555 time 7840133492555 state 0x1 ref 1 00000100:00100000:3.0:1777580319.215837:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840133592555 time 7840164698221 state 0x0 ref 1 00000100:00100000:3.0:1777580319.215859:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283511:x1863919946806656:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580319.215958:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580319.216000:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4d7ec lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef2e expref: 395 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216032:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbc000/0xcb2b2f2f7e4d66b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eed3 expref: 394 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216046:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa02498f4a100) 00010000:00010000:3.0:1777580319.216061:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.216124:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216181:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216197:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216220:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216227:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.216234:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.217106:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.217119:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.217128:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580319.220311:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1914, 64 off130688 00010000:00010000:3.0:1777580319.220744:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220776:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220803:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220813:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220820:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220827:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220845:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580319.220880:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220887:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220892:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220899:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.220904:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220912:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220925:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa024993df600) 00010000:00010000:3.0:1777580319.220928:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580319.220943:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220949:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4d9f2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220970:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220976:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220981:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220986:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.220988:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.220994:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.221002:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.221004:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.221007:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.221012:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4d9e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.221022:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001362bf4f reply state 00000000cf5cfe11 transno 8589951081 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.221044:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.221234:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+395:283511:x1863919946806656:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5380us (7030us total) trans 8589951081 rc 0/0 00000100:00100000:3.0:1777580319.221247:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19947 00000100:00100000:3.0:1777580319.221257:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840133592555 time 7840164698221 state 0x2 ref 0 00010000:00010000:2.0:1777580319.223113:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.223125:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.223150:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.223155:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.223166:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.223200:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81b:0x0].0x0 (ffffa024993df600) 00010000:00010000:2.0:1777580319.223203:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.223208:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.223213:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4d9f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.223246:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.223248:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.223250:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.226073:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226103:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226112:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226119:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.226124:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226132:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226169:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024993dfe00) 00010000:00010000:2.0:1777580319.226173:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.226177:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.226195:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4d9eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.227909:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.228992:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946806912 00000100:00100000:2.0:1777580319.229007:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946806912 00000100:00100000:2.0:1777580319.229074:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840133592555 time 7840164698221 state 0x0 ref 1 00000100:00100000:2.0:1777580319.230397:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840164798221 time 7840164698221 state 0x1 ref 1 00000100:00100000:2.0:1777580319.230438:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840164798221 time 7840179299399 state 0x0 ref 1 00000100:00100000:2.0:1777580319.230465:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283506:x1863919946806912:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.230543:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.230578:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4d7b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x817:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef20 expref: 394 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230606:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02395f9b000/0xcb2b2f2f7e4d4c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x817:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee5c expref: 393 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230619:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0248a60ed00) 00010000:00010000:2.0:1777580319.230631:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.230659:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230676:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230687:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230714:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230721:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230728:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230896:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230905:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.230912:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.233801:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1915, 64 off130752 00010000:00010000:2.0:1777580319.233906:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.233930:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.233944:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.233953:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.233960:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.233973:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234003:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.234036:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234041:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234047:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234052:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.234058:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234067:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234863:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580319.234873:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.234881:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234891:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4da0e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x817:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234919:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234938:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234944:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234949:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e5600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.234953:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234959:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234971:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.234973:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.234976:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.234982:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4da00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.234994:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bdbe80eb reply state 00000000d30c40d8 transno 8589951082 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.235005:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.235626:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+394:283506:x1863919946806912:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5168us (7895us total) trans 8589951082 rc 0/0 00000100:00100000:2.0:1777580319.235638:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19948 00000100:00100000:2.0:1777580319.235648:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840164798221 time 7840179299399 state 0x2 ref 0 00010000:00010000:2.0:1777580319.235757:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.235776:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.235784:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.235788:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.235797:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.235812:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x817:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580319.235815:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.235819:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.235825:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4da15 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x817:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.235848:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.235850:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.235851:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.241275:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241307:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241316:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241324:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.241344:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241353:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241374:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa0241785f300) 00010000:00010000:2.0:1777580319.241378:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.241383:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.241390:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4da07 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.244384:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.244431:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946807168 00000100:00100000:2.0:1777580319.244446:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946807168 00000100:00100000:2.0:1777580319.244495:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840164798221 time 7840179299399 state 0x0 ref 1 00000100:00100000:2.0:1777580319.244510:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840179399399 time 7840179299399 state 0x1 ref 1 00000100:00100000:2.0:1777580319.244539:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840179399399 time 7840193400221 state 0x0 ref 1 00000100:00100000:2.0:1777580319.244552:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283513:x1863919946807168:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.244633:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.244668:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4d8f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef74 expref: 393 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244691:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4d70c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eef6 expref: 392 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244716:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024c6346000) 00010000:00010000:2.0:1777580319.244732:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.244764:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244793:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244805:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244824:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244832:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.244839:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.245000:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.245008:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.245015:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.245648:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1916, 64 off130816 00010000:00010000:2.0:1777580319.245724:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246043:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246053:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246061:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246066:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246072:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246101:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.246129:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246158:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246164:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246170:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.246175:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246183:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246207:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:2.0:1777580319.246210:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.246214:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246220:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da2a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246242:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246249:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246254:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246260:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.246262:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246269:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246277:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.246279:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.246328:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246336:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.246359:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac5e9166 reply state 000000005106de66 transno 8589951083 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.246369:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.246477:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+393:283513:x1863919946807168:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1923us (2102us total) trans 8589951083 rc 0/0 00000100:00100000:2.0:1777580319.246488:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19949 00000100:00100000:2.0:1777580319.246496:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840179399399 time 7840193400221 state 0x2 ref 0 00010000:00010000:2.0:1777580319.246550:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.246556:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246563:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.246566:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246573:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246581:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81d:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:2.0:1777580319.246584:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.246587:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246592:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da31 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.246606:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.246608:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.246616:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.251102:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251126:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251150:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251158:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.251164:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251172:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251193:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa024997a0d00) 00010000:00010000:3.0:1777580319.251197:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.251202:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.251209:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4da23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.262051:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.262112:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946807424 00000100:00100000:2.0:1777580319.262125:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946807424 00000100:00100000:2.0:1777580319.262197:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840179399399 time 7840193400221 state 0x0 ref 1 00000100:00100000:2.0:1777580319.262213:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840193500221 time 7840193400221 state 0x1 ref 1 00000100:00100000:2.0:1777580319.262240:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840193500221 time 7840211101921 state 0x0 ref 1 00000100:00100000:2.0:1777580319.262252:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283516:x1863919946807424:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.262887:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.263127:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4d94a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x820:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef89 expref: 392 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263177:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4d86a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x820:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef6d expref: 391 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263191:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa0249dea8500) 00010000:00010000:2.0:1777580319.263203:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.263233:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263250:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263262:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263278:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263857:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.263866:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.264023:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.264031:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.264038:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.266104:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1911, 64 off130496 00010000:00010000:2.0:1777580319.266232:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266255:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266269:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266280:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266868:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266877:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266908:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.266946:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266952:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266958:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266965:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.266970:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266978:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.266993:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa024ad9fd800) 00010000:00010000:2.0:1777580319.266996:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.267001:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267008:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4da46 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x820:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267030:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267036:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267052:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267057:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.267059:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267066:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267073:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.267076:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.267079:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.267085:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4da38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.267095:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000506c94bc reply state 0000000068c898f9 transno 8589951084 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.267104:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.267247:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+392:283516:x1863919946807424:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4990us (5203us total) trans 8589951084 rc 0/0 00000100:00100000:2.0:1777580319.267257:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19950 00000100:00100000:2.0:1777580319.267267:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840193500221 time 7840211101921 state 0x2 ref 0 00010000:00010000:2.0:1777580319.268484:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.268498:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.268523:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.268527:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.268537:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.268555:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x820:0x0].0x0 (ffffa024ad9fd800) 00010000:00010000:2.0:1777580319.268558:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.268562:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.268569:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4da4d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x820:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.268590:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.268592:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.268594:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580319.274593:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580319.274631:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274644:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274653:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274659:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fcc00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.274664:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274684:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274705:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024ad9fd500) 00010000:00010000:2.0:1777580319.274708:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.274714:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274721:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4da3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.274779:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946807680 00000100:00100000:2.0:1777580319.274792:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946807680 00000100:00100000:2.0:1777580319.274832:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840193500221 time 7840211101921 state 0x0 ref 1 00000100:00100000:2.0:1777580319.274846:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840211201921 time 7840211101921 state 0x1 ref 1 00000100:00100000:2.0:1777580319.274872:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840211201921 time 7840223734153 state 0x0 ref 1 00000100:00100000:2.0:1777580319.274885:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283512:x1863919946807680:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580319.274960:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580319.274980:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4d92e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef82 expref: 391 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.274998:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbca00/0xcb2b2f2f7e4d6db lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eee8 expref: 390 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275007:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa02499479000) 00010000:00010000:2.0:1777580319.275020:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.275046:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275061:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275074:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275088:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275096:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275102:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275265:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275273:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.275280:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580319.277728:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1912, 64 off130560 00010000:00010000:2.0:1777580319.277848:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277871:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277891:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277901:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277908:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277915:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277939:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580319.277966:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.277972:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279721:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279731:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.279823:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279835:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279860:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa024ad9fdf00) 00010000:00010000:2.0:1777580319.279864:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580319.279886:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279893:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4da62 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279932:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279940:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279945:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279949:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.279951:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279955:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279963:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.279965:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.279968:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.279972:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4da54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.279985:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e125fcbb reply state 00000000e9d46809 transno 8589951085 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.280008:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.280194:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+391:283512:x1863919946807680:12345-192.168.202.9@tcp:36:rm.500 Request processed in 5301us (5602us total) trans 8589951085 rc 0/0 00000100:00100000:2.0:1777580319.280207:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19951 00000100:00100000:2.0:1777580319.280218:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840211201921 time 7840223734153 state 0x2 ref 0 00010000:00010000:2.0:1777580319.280840:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.280850:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.280859:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.280862:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.280870:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.280881:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81c:0x0].0x0 (ffffa024ad9fdf00) 00010000:00010000:2.0:1777580319.280883:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.280887:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.280893:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4da69 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.280915:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.280917:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.280919:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580319.288410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580319.288449:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.288464:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.288474:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.289810:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.289819:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.289832:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.289856:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa024ad9fd400) 00010000:00010000:3.0:1777580319.289860:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.289865:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.289873:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4da5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.289934:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946807936 00000100:00100000:3.0:1777580319.289947:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946807936 00000100:00100000:3.0:1777580319.289993:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840211201921 time 7840223734153 state 0x0 ref 1 00000100:00100000:3.0:1777580319.290007:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840223834153 time 7840223734153 state 0x1 ref 1 00000100:00100000:3.0:1777580319.290052:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840223834153 time 7840238914450 state 0x0 ref 1 00000100:00100000:3.0:1777580319.290070:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283514:x1863919946807936:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580319.290184:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580319.290208:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4d966 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef90 expref: 390 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290226:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384c32200/0xcb2b2f2f7e4d759 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef04 expref: 389 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290235:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa02417834e00) 00010000:00010000:3.0:1777580319.290251:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.290285:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290303:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290316:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290331:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290338:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.290345:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.292096:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.292116:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.292127:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580319.293964:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1913, 64 off130624 00010000:00010000:3.0:1777580319.294046:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294061:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294072:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294078:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294083:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294087:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294109:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580319.294158:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.294175:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580319.294176:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294183:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.294186:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294189:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.294191:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580319.294194:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.294195:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.294203:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.294203:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296377:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580319.296389:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580319.296400:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296414:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4da7e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.296425:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81e:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:0.0:1777580319.296430:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580319.296434:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.296440:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4da85 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296444:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296451:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296457:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.296463:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.296467:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.296469:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580319.296472:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.296474:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.297672:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.297704:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.297708:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.297715:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.297725:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4da70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.297741:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005c8e19ae reply state 0000000039e1029b transno 8589951086 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.297753:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.297904:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248b80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283514:x1863919946807936:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7834us (9501us total) trans 8589951086 rc 0/0 00000100:00100000:3.0:1777580319.297917:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19952 00000100:00100000:3.0:1777580319.297926:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840223834153 time 7840238914450 state 0x2 ref 0 00000100:00100000:3.0:1777580319.302120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.305168:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946808192 00000100:00100000:3.0:1777580319.305187:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946808192 00000100:00100000:3.0:1777580319.305243:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840223834153 time 7840238914450 state 0x0 ref 1 00000100:00100000:3.0:1777580319.305261:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840239014450 time 7840238914450 state 0x1 ref 1 00000100:00100000:3.0:1777580319.305293:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840239014450 time 7840254154906 state 0x0 ref 1 00000100:00100000:3.0:1777580319.305319:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+390:283515:x1863919946808192:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580319.305398:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580319.305431:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4d912 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef7b expref: 390 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.305455:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02404cbda00/0xcb2b2f2f7e4d7f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0x81f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef43 expref: 389 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.305466:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa02498f4a400) 00010000:00010000:3.0:1777580319.306655:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.306703:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306727:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306739:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306761:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306778:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306785:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306939:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306955:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.306960:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307424:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307433:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307440:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307446:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.307451:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307468:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307481:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa024993df900) 00010000:00010000:0.0:1777580319.307484:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.307488:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.307494:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4da77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580319.313019:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1917, 64 off130880 00010000:00010000:3.0:1777580319.313301:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313325:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313338:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313348:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313355:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313362:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313382:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580319.313411:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313416:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313439:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313446:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ea00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.313451:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313458:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313473:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580319.313476:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580319.313481:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313488:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4da9a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x81f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313509:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313514:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313519:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313524:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.313526:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.313540:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.315923:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580319.315939:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.315962:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580319.315968:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.315979:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.315999:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x81f:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580319.316002:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580319.316006:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.316013:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4daa1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x81f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.316043:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.316045:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580319.316047:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580319.316154:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.316157:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.316162:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.316169:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4da8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.316186:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4a5fca8 reply state 00000000f30f3fc7 transno 8589951087 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.316196:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.316336:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+389:283515:x1863919946808192:12345-192.168.202.9@tcp:36:rm.500 Request processed in 11017us (14222us total) trans 8589951087 rc 0/0 00000100:00100000:3.0:1777580319.316349:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19953 00000100:00100000:3.0:1777580319.316359:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840239014450 time 7840254154906 state 0x2 ref 0 00010000:00010000:2.0:1777580319.320464:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320498:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320507:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320514:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.320521:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320564:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320585:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024993df600) 00010000:00010000:2.0:1777580319.320588:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.320593:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.320600:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4da93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.339811:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580319.392914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.395030:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946808448 00000100:00100000:2.0:1777580319.395052:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946808448 00000100:00100000:2.0:1777580319.395125:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839903956301 time 7839931336794 state 0x0 ref 1 00000100:00100000:2.0:1777580319.398111:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839931436794 time 7839931336794 state 0x1 ref 1 00000100:00100000:2.0:1777580319.398177:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839931436794 time 7840347039065 state 0x0 ref 1 00000100:00100000:2.0:1777580319.398206:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+100:283523:x1863919946808448:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.398238:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.398264:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daa8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efba expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777580319.399068:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777580319.408937:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.408962:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.408989:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.409008:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.409016:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.409023:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580319.413080:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15ff:0x0], index 0: 0 00010000:00010000:2.0:1777580319.413415:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dabd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413436:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dabd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413450:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dabd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413498:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413507:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413513:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413520:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.413532:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413542:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413557:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.413561:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.413566:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.413573:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4daaf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.416871:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dda7c71e reply state 00000000116beca2 transno 8589951088 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.416885:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580319.416966:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daa8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efba expref: 103 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.416985:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dabd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efba expref: 102 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.416996:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd500) 00010000:00010000:2.0:1777580319.416998:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.417003:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fda00, rc 0) 00000100:00100000:2.0:1777580319.417115:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283523:x1863919946808448:12345-192.168.202.9@tcp:101:touch.500 Request processed in 18924us (24213us total) trans 8589951088 rc 0/0 00000100:00100000:2.0:1777580319.417126:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19954 00000100:00100000:2.0:1777580319.417167:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839931436794 time 7840347039065 state 0x2 ref 0 00000100:00100000:1.0:1777580319.453187:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.453473:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946808704 00010000:00010000:0.0:1777580319.453779:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453795:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453804:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453810:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.453816:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453824:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453842:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa024ad9fdf00) 00010000:00010000:0.0:1777580319.453846:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.453867:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.453874:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dab6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.456834:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946808704 00000100:00100000:2.0:1777580319.456911:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7839931436794 time 7840347039065 state 0x0 ref 1 00000100:00100000:2.0:1777580319.456930:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840347139065 time 7840347039065 state 0x1 ref 1 00000100:00100000:2.0:1777580319.456983:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840347139065 time 7840405844702 state 0x0 ref 1 00000100:00100000:2.0:1777580319.457004:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+102:283523:x1863919946808704:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580319.457092:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580319.457128:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dabd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efba expref: 102 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.457169:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd500) 00010000:00010000:2.0:1777580319.457181:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.457277:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.457293:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.457305:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.457491:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ab6e04e1 reply state 00000000b349d44b transno 8589951089 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.457502:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.457651:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283523:x1863919946808704:12345-192.168.202.9@tcp:36:touch.500 Request processed in 655us (4476us total) trans 8589951089 rc 0/0 00000100:00100000:2.0:1777580319.457659:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19955 00000100:00100000:2.0:1777580319.457665:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840347139065 time 7840405844702 state 0x2 ref 0 00000100:00100000:2.0:1777580319.464174:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.464265:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946808960 00000100:00100000:2.0:1777580319.464277:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946808960 00000100:00100000:2.0:1777580319.464325:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840347139065 time 7840405844702 state 0x0 ref 1 00000100:00100000:2.0:1777580319.464340:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840405944702 time 7840405844702 state 0x1 ref 1 00000100:00100000:2.0:1777580319.464367:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840405944702 time 7840413229465 state 0x0 ref 1 00000100:00100000:2.0:1777580319.464379:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+103:283533:x1863919946808960:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.464406:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.464432:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4dad2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efc1 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466895:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466926:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466942:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466962:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466989:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.466996:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580319.473961:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15db:0x0], index 1: 0 00010000:00010000:2.0:1777580319.474333:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4dae7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474357:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4dae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474373:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4dae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474422:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474431:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474438:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474444:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.474449:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474457:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474491:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.474494:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.474500:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474506:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dad9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.474523:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000063026c06 reply state 0000000093fcc9b6 transno 8589951090 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.474533:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580319.474686:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4dad2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc1 expref: 106 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474705:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4dae7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc1 expref: 105 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.474713:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024ad9fd000) 00010000:00010000:2.0:1777580319.474716:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.474719:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fde00, rc 0) 00000100:00100000:2.0:1777580319.474840:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283533:x1863919946808960:12345-192.168.202.9@tcp:101:touch.500 Request processed in 10461us (10674us total) trans 8589951090 rc 0/0 00000100:00100000:2.0:1777580319.474850:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19956 00000100:00100000:2.0:1777580319.474860:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840405944702 time 7840413229465 state 0x2 ref 0 00000100:00100000:1.0:1777580319.475281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580319.477993:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478033:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478041:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478046:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.478052:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478060:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478081:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd800) 00010000:00010000:2.0:1777580319.478084:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.478090:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478096:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dacb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.478172:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946809088 00000100:00100000:2.0:1777580319.478184:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946809088 00000100:00100000:2.0:1777580319.478228:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840405944702 time 7840413229465 state 0x0 ref 1 00000100:00100000:2.0:1777580319.478242:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840413329465 time 7840413229465 state 0x1 ref 1 00000100:00100000:2.0:1777580319.478276:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840413329465 time 7840427138783 state 0x0 ref 1 00000100:00100000:2.0:1777580319.478294:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+105:283523:x1863919946809088:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.478334:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.478361:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daf5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efc8 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478436:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x841:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc8 expref: 106 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478451:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x841:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc8 expref: 106 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.478471:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:2.0:1777580319.478474:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580319.478477:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a680e600, rc 0) 00000100:00100000:2.0:1777580319.478563:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+106:283523:x1863919946809088:12345-192.168.202.9@tcp:101:touch.500 Request processed in 276us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.478571:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19957 00000100:00100000:2.0:1777580319.481471:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840413329465 time 7840427138783 state 0x2 ref 0 00000100:00100000:3.0:1777580319.484667:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.484777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.484814:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946809344 00000100:00100000:3.0:1777580319.484827:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946809344 00000100:00100000:3.0:1777580319.484877:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840413329465 time 7840427138783 state 0x0 ref 1 00000100:00100000:3.0:1777580319.484893:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840427238783 time 7840427138783 state 0x1 ref 1 00000100:00100000:3.0:1777580319.484914:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946809600 00000100:00100000:3.0:1777580319.484929:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946809600 00000100:00100000:3.0:1777580319.484944:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840427238783 time 7840427138783 state 0x1 ref 2 00000100:00100000:3.0:1777580319.484966:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840433927665 time 7840433827665 state 0x1 ref 2 00000100:00100000:3.0:1777580319.484978:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283533:x1863919946809344:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580319.485056:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.485093:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4dae7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc1 expref: 107 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.485115:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024ad9fd000) 00010000:00010000:3.0:1777580319.485128:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.485259:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.485276:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.485289:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.485481:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7824cae reply state 00000000e7da2178 transno 8589951091 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.485492:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.485610:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283533:x1863919946809344:12345-192.168.202.9@tcp:36:touch.500 Request processed in 633us (956us total) trans 8589951091 rc 0/0 00000100:00100000:3.0:1777580319.485619:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19958 00000100:00100000:3.0:1777580319.485648:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840433927665 time 7840434511219 state 0x0 ref 1 00000100:00100000:3.0:1777580319.485670:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+107:283525:x1863919946809600:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.485681:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.485694:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4db03 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efcf expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486494:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486513:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486524:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486672:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486680:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.486688:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580319.487436:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1600:0x0], index 0: 0 00010000:00010000:0.0:1777580319.487915:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487927:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487935:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487942:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.487947:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487955:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487970:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024ad9fd100) 00010000:00010000:0.0:1777580319.487973:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.487979:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.487985:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dae0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.488490:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4db18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.488504:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4db18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.488516:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4db18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.489954:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.489973:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.489982:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.489988:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.489993:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.490002:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.490019:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.490023:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.490027:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.490034:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4db0a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.490053:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001915e17b reply state 00000000615bfe24 transno 8589951092 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.490063:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.490128:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e5600/0xcb2b2f2f7e4db03 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efcf expref: 109 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.490190:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4db18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efcf expref: 108 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.490199:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa024993df900) 00010000:00010000:3.0:1777580319.490201:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.490204:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4a00, rc 0) 00000100:00100000:3.0:1777580319.490297:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283525:x1863919946809600:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4627us (5519us total) trans 8589951092 rc 0/0 00000100:00100000:3.0:1777580319.490309:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19959 00000100:00100000:3.0:1777580319.490319:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840433927665 time 7840434511219 state 0x2 ref 0 00000100:00100000:3.0:1777580319.490446:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.496006:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946809728 00000100:00100000:1.0:1777580319.496023:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946809728 00000100:00100000:1.0:1777580319.496099:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12187 00000100:00100000:1.0:1777580319.496112:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2364:x1863919946809728:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580319.497892:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946809728:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1770us (7432us total) trans 8589939093 rc 0/0 00000100:00100000:1.0:1777580319.497907:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12187 00010000:00010000:2.0:1777580319.503909:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.503932:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.503941:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.503947:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.503954:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.503979:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.504000:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024993df600) 00010000:00010000:2.0:1777580319.504003:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.504008:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.504015:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4c00/0xcb2b2f2f7e4dafc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.511089:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.511252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.511863:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946810112 00000100:00100000:2.0:1777580319.511879:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946810112 00000100:00100000:2.0:1777580319.511957:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4268 00000100:00100000:2.0:1777580319.511968:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283523:x1863919946810112:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.512467:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283523:x1863919946810112:12345-192.168.202.9@tcp:35:touch.500 Request processed in 499us (1213us total) trans 8589951093 rc 0/0 00000100:00100000:2.0:1777580319.512476:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4268 00010000:00010000:0.0:1777580319.512817:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512853:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512861:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512869:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.512875:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512885:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512904:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024993dfa00) 00010000:00010000:0.0:1777580319.512908:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.512914:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.512920:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4db11 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.517098:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946809856 00000100:00100000:3.0:1777580319.517118:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946809856 00000100:00100000:3.0:1777580319.517234:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840433927665 time 7840434511219 state 0x0 ref 1 00000100:00100000:3.0:1777580319.517249:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840434611219 time 7840434511219 state 0x1 ref 1 00000100:00100000:3.0:1777580319.517286:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840434611219 time 7840466147966 state 0x0 ref 1 00000100:00100000:3.0:1777580319.517305:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+108:283533:x1863919946809856:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.517332:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.520630:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4db26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efd6 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.520747:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4db26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x842:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efd6 expref: 109 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.520784:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4db26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x842:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efd6 expref: 109 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.520809:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580319.520813:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.520818:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fde00, rc 0) 00000100:00100000:3.0:1777580319.521058:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283533:x1863919946809856:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3759us (9983us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.521070:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19960 00000100:00100000:3.0:1777580319.521079:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840434611219 time 7840466147966 state 0x2 ref 0 00000100:00100000:3.0:1777580319.521278:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.523761:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946810368 00000100:00100000:1.0:1777580319.523790:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946810368 00000100:00100000:1.0:1777580319.523855:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840434611219 time 7840466147966 state 0x0 ref 1 00000100:00100000:1.0:1777580319.523872:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840466247966 time 7840466147966 state 0x1 ref 1 00000100:00100000:1.0:1777580319.523911:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840466247966 time 7840472773714 state 0x0 ref 1 00000100:00100000:1.0:1777580319.523932:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283525:x1863919946810368:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580319.524014:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580319.524049:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4db18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efcf expref: 109 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.524074:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa024993df900) 00010000:00010000:1.0:1777580319.524093:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580319.525530:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.525571:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946810624 00000100:00100000:3.0:1777580319.525591:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946810624 00000100:00100000:3.0:1777580319.525643:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840472873714 time 7840472773714 state 0x1 ref 2 00000100:00100000:3.0:1777580319.525670:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840472873714 time 7840474533476 state 0x0 ref 2 00000100:00100000:3.0:1777580319.525682:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+109:283539:x1863919946810624:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.525705:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.525728:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db2d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efdd expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527303:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527353:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527368:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527389:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527396:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.527402:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.531516:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.531557:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.531580:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580319.535668:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000724ec327 reply state 00000000629b3bc3 transno 8589951094 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.535700:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580319.536047:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283525:x1863919946810368:12345-192.168.202.9@tcp:36:touch.500 Request processed in 12114us (14760us total) trans 8589951094 rc 0/0 00000100:00100000:1.0:1777580319.536061:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19961 00000100:00100000:1.0:1777580319.542183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:3.0:1777580319.543023:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15dc:0x0], index 1: 0 00010000:00010000:3.0:1777580319.543324:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4db49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.543488:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.543499:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.543507:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.543513:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.543519:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.543554:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.544706:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa02427669b00) 00010000:00010000:2.0:1777580319.544715:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.544727:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.544924:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4db42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545173:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4db49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545190:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4db49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545277:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545286:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545293:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545318:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.545322:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545329:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545353:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.545357:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.545361:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545366:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.545380:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021fdc50f reply state 0000000038545f8d transno 8589951095 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.545390:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.545450:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db2d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efdd expref: 112 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545465:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4db49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efdd expref: 111 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.545473:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580319.545476:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.545479:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fc600, rc 0) 00000100:00100000:3.0:1777580319.545597:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+112:283539:x1863919946810624:12345-192.168.202.9@tcp:101:touch.500 Request processed in 19916us (20077us total) trans 8589951095 rc 0/0 00000100:00100000:3.0:1777580319.545615:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19962 00000100:00100000:3.0:1777580319.545625:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840472873714 time 7840474533476 state 0x2 ref 0 00000100:00100000:3.0:1777580319.545690:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946810752 00000100:00100000:3.0:1777580319.545701:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946810752 00000100:00100000:3.0:1777580319.545774:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12188 00000100:00100000:3.0:1777580319.545784:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946810752:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580319.546181:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2363:x1863919946810752:12345-192.168.202.9@tcp:2:touch.500 Request processed in 398us (4371us total) trans 8589938693 rc 0/0 00000100:00100000:3.0:1777580319.546189:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12188 00000100:00100000:3.0:1777580319.573207:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.573244:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.573267:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.573289:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.573338:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946810880 00000100:00100000:3.0:1777580319.573933:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946810880 00000100:00100000:3.0:1777580319.573986:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840472873714 time 7840474533476 state 0x0 ref 1 00000100:00100000:3.0:1777580319.574003:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840474633476 time 7840474533476 state 0x1 ref 1 00000100:00100000:3.0:1777580319.574036:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946811392 00000100:00100000:3.0:1777580319.574040:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946811392 00000100:00100000:3.0:1777580319.574052:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840474633476 time 7840474533476 state 0x1 ref 2 00000100:00100000:3.0:1777580319.574068:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946811648 00000100:00100000:3.0:1777580319.574071:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946811648 00000100:00100000:3.0:1777580319.574084:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840474633476 time 7840474533476 state 0x1 ref 3 00000100:00100000:3.0:1777580319.574129:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840523090448 time 7840522990448 state 0x1 ref 3 00000100:00100000:3.0:1777580319.574168:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283525:x1863919946810880:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.574201:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.574236:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efe4 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.574315:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x843:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efe4 expref: 115 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.574334:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x843:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efe4 expref: 115 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574486:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574497:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574505:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574512:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.574527:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574537:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.574566:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa024993df600) 00010000:00010000:0.0:1777580319.574570:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.574854:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa024993df900) 00010000:00010000:3.0:1777580319.574858:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.574861:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fcc00, rc 0) 00000100:00100000:3.0:1777580319.574947:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283525:x1863919946810880:12345-192.168.202.9@tcp:101:touch.500 Request processed in 783us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.574956:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19963 00000100:00100000:3.0:1777580319.574987:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840523950303 time 7840523850303 state 0x1 ref 2 00000100:00100000:3.0:1777580319.574999:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+114:283528:x1863919946811392:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.575011:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.575026:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90efeb expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575218:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575231:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575242:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575258:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575265:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.575273:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.575455:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.575464:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4db3b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.577700:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946811136 00000100:00100000:2.0:1777580319.577723:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946811136 00000100:00100000:2.0:1777580319.577827:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4269 00000100:00100000:2.0:1777580319.577839:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283533:x1863919946811136:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.578357:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+116:283533:x1863919946811136:12345-192.168.202.9@tcp:35:touch.500 Request processed in 506us (5097us total) trans 8589951096 rc 0/0 00000100:00100000:2.0:1777580319.578367:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4269 00000100:00100000:2.0:1777580319.579921:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840523950303 time 7840528774455 state 0x0 ref 2 00000100:00100000:2.0:1777580319.579958:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+115:283539:x1863919946811648:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580319.580021:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580319.580053:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4db49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efdd expref: 115 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.580076:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580319.580104:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.580213:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.580229:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.580242:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580319.582107:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1601:0x0], index 0: 0 00000004:00010000:2.0:1777580319.582542:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000afc0c686 reply state 000000000a05b405 transno 8589951097 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.582557:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.584965:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283539:x1863919946811648:12345-192.168.202.9@tcp:36:touch.500 Request processed in 5004us (11654us total) trans 8589951097 rc 0/0 00000100:00100000:2.0:1777580319.584982:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19965 00010000:00010000:3.0:1777580319.590024:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4db7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590054:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4db7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590069:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4db7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590122:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590255:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590262:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590268:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.590274:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590281:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590296:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.590300:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.590306:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.590312:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4db65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.590328:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000102f6550 reply state 00000000450e65f1 transno 8589951098 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.590339:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.592971:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4db5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efeb expref: 117 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593010:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4db7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efeb expref: 116 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593044:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:3.0:1777580319.593047:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.593051:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4f800, rc 0) 00000100:00100000:3.0:1777580319.593173:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283528:x1863919946811392:12345-192.168.202.9@tcp:101:touch.500 Request processed in 18173us (19901us total) trans 8589951098 rc 0/0 00000100:00100000:3.0:1777580319.593185:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19964 00000100:00100000:3.0:1777580319.593195:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840523950303 time 7840528774455 state 0x2 ref 0 00010000:00010000:3.0:1777580319.593272:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593282:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593289:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593297:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.593302:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593310:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.593326:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024ad9fd800) 00010000:00010000:3.0:1777580319.593328:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.593332:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.596297:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4db73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.598978:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.599503:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946811776 00000100:00100000:2.0:1777580319.599517:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946811776 00000100:00100000:2.0:1777580319.599696:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12189 00000100:00100000:2.0:1777580319.599709:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2362:x1863919946811776:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580319.601904:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2362:x1863919946811776:12345-192.168.202.9@tcp:2:touch.500 Request processed in 2186us (2931us total) trans 8589939094 rc 0/0 00000100:00100000:2.0:1777580319.601918:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12189 00010000:00010000:1.0:1777580319.606189:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606208:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606217:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606224:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.606229:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606239:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606260:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02417834e00) 00010000:00010000:1.0:1777580319.606264:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.606270:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.606277:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4db6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.611835:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.611874:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.611902:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.611940:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946811904 00000100:00100000:3.0:1777580319.611957:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946811904 00000100:00100000:3.0:1777580319.612020:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840523950303 time 7840528774455 state 0x0 ref 1 00000100:00100000:3.0:1777580319.612040:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840528874455 time 7840528774455 state 0x1 ref 1 00000100:00100000:3.0:1777580319.612061:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946812160 00000100:00100000:3.0:1777580319.612064:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946812160 00000100:00100000:3.0:1777580319.612078:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840528874455 time 7840528774455 state 0x1 ref 2 00000100:00100000:3.0:1777580319.612091:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946812416 00000100:00100000:3.0:1777580319.612094:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946812416 00000100:00100000:3.0:1777580319.612107:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840528874455 time 7840528774455 state 0x1 ref 3 00000100:00100000:3.0:1777580319.612126:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561088087 time 7840560988087 state 0x1 ref 3 00000100:00100000:3.0:1777580319.612165:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283539:x1863919946811904:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.612199:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.612233:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4db88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eff2 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612317:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4db88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x844:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff2 expref: 118 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612358:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4db88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x844:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff2 expref: 118 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612384:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024c6346000) 00010000:00010000:3.0:1777580319.612387:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.612391:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ea00, rc 0) 00000100:00100000:3.0:1777580319.612461:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+118:283539:x1863919946811904:12345-192.168.202.9@tcp:101:touch.500 Request processed in 325us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.612469:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19966 00000100:00100000:3.0:1777580319.612496:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561459071 time 7840561359071 state 0x1 ref 2 00000100:00100000:3.0:1777580319.612505:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283528:x1863919946812160:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580319.612558:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.612580:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4db7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efeb expref: 117 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612597:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:3.0:1777580319.612604:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.612676:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612685:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.612695:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.612909:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d0b3d669 reply state 00000000d4737f27 transno 8589951099 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.612918:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.612983:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+118:283528:x1863919946812160:12345-192.168.202.9@tcp:36:touch.500 Request processed in 478us (1107us total) trans 8589951099 rc 0/0 00000100:00100000:3.0:1777580319.612990:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19967 00000100:00100000:3.0:1777580319.613008:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561459071 time 7840561870817 state 0x0 ref 1 00000100:00100000:3.0:1777580319.613017:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+117:283529:x1863919946812416:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.613026:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.613037:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4db96 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90eff9 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613181:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613193:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613201:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613216:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613223:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.613244:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580319.614823:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15dd:0x0], index 1: 0 00010000:00010000:3.0:1777580319.615104:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dbab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615124:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dbab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615155:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dbab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615207:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615215:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615223:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615232:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.615237:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615246:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615262:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.615265:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.615289:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.615296:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4db9d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.615313:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed1117a6 reply state 00000000e0ef55da transno 8589951100 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.615322:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.616022:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4db96 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff9 expref: 120 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.616050:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dbab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff9 expref: 119 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.616058:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:3.0:1777580319.616061:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.616064:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4da00, rc 0) 00000100:00100000:3.0:1777580319.616219:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+120:283529:x1863919946812416:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3199us (4312us total) trans 8589951100 rc 0/0 00000100:00100000:3.0:1777580319.616231:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19968 00000100:00100000:3.0:1777580319.616240:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561459071 time 7840561870817 state 0x2 ref 0 00000100:00100000:0.0:1777580319.633865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.635557:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.635606:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.635727:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.635816:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946812928 00000100:00100000:0.0:1777580319.635830:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946812928 00000100:00100000:0.0:1777580319.635883:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561459071 time 7840561870817 state 0x0 ref 1 00000100:00100000:0.0:1777580319.635898:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561970817 time 7840561870817 state 0x1 ref 1 00000100:00100000:0.0:1777580319.635921:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946813184 00000100:00100000:0.0:1777580319.635924:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946813184 00000100:00100000:0.0:1777580319.635935:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840561970817 time 7840561870817 state 0x1 ref 2 00000100:00100000:0.0:1777580319.635953:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840584915966 time 7840584815966 state 0x1 ref 2 00000100:00100000:0.0:1777580319.635965:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+121:283528:x1863919946812928:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580319.636006:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.636033:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9a00/0xcb2b2f2f7e4dbb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f000 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636115:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9a00/0xcb2b2f2f7e4dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x845:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f000 expref: 122 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636155:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9a00/0xcb2b2f2f7e4dbb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x845:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f000 expref: 122 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636184:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:0.0:1777580319.636188:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580319.636192:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9a00, rc 0) 00000100:00100000:0.0:1777580319.636267:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+122:283528:x1863919946812928:12345-192.168.202.9@tcp:101:touch.500 Request processed in 303us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580319.636276:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19969 00000100:00100000:0.0:1777580319.636301:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840584915966 time 7840585163897 state 0x0 ref 1 00000100:00100000:0.0:1777580319.636311:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+121:283529:x1863919946813184:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580319.636368:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580319.636391:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dbab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff9 expref: 121 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636408:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa0249076ff00) 00010000:00010000:0.0:1777580319.636418:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580319.636491:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636509:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.636517:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580319.636705:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c2134c60 reply state 0000000097a514f3 transno 8589951101 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.636715:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580319.636802:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024acde3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+122:283529:x1863919946813184:12345-192.168.202.9@tcp:36:touch.500 Request processed in 491us (1194us total) trans 8589951101 rc 0/0 00000100:00100000:0.0:1777580319.636809:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19970 00000100:00100000:0.0:1777580319.636813:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840584915966 time 7840585163897 state 0x2 ref 0 00000100:00100000:0.0:1777580319.636846:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946812800 00000100:00100000:0.0:1777580319.636851:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946812800 00000100:00100000:0.0:1777580319.638321:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12190 00000100:00100000:0.0:1777580319.638348:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2364:x1863919946812800:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580319.639928:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946812672 00000100:00100000:2.0:1777580319.639950:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946812672 00000100:00100000:2.0:1777580319.640044:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4270 00000100:00100000:2.0:1777580319.640058:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+122:283525:x1863919946812672:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:1.0:1777580319.640954:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.640972:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.640981:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.640988:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.640995:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.641004:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.641024:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa0249076f700) 00010000:00010000:1.0:1777580319.641027:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.641033:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.641041:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dba4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644011:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644034:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644042:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644056:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.644062:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644071:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644093:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:3.0:1777580319.644096:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.644102:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.644108:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4db8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.644553:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946812800:12345-192.168.202.9@tcp:2:touch.500 Request processed in 6199us (8805us total) trans 8589938694 rc 0/0 00000100:00100000:0.0:1777580319.644568:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12190 00000100:00100000:2.0:1777580319.654595:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+121:283525:x1863919946812672:12345-192.168.202.9@tcp:35:touch.500 Request processed in 14510us (20716us total) trans 8589951102 rc 0/0 00000100:00100000:2.0:1777580319.654625:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4270 00000100:00100000:3.0:1777580319.659044:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580319.663317:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663339:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663355:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663361:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.663368:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663377:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663408:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa0248a60e600) 00010000:00010000:3.0:1777580319.663412:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.663418:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.663426:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9800/0xcb2b2f2f7e4dbc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.667821:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946813440 00000100:00100000:2.0:1777580319.667846:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946813440 00000100:00100000:3.0:1777580319.668267:0:205909:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840584915966 time 7840585163897 state 0x0 ref 1 00000100:00100000:3.0:1777580319.668286:0:205909:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840585263897 time 7840585163897 state 0x1 ref 1 00000100:00100000:3.0:1777580319.668322:0:205909:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840585263897 time 7840617183858 state 0x0 ref 1 00000100:00100000:3.0:1777580319.668342:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+120:283530:x1863919946813440:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.668371:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.668398:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dbc7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f007 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.668973:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.668995:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.669010:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.669027:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.669050:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.669057:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580319.671940:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1602:0x0], index 0: 0 00010000:00010000:3.0:1777580319.672258:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dbdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672283:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672298:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672347:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672356:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672363:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672369:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.672374:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672382:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672408:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.672411:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.672417:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672424:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dbce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.672439:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009889c26a reply state 00000000287dd8bc transno 8589951103 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.672450:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.672500:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dbc7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f007 expref: 123 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672517:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f007 expref: 122 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.672524:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:3.0:1777580319.672526:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.672529:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7800, rc 0) 00000100:00100000:1.0:1777580319.672993:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.673051:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.673180:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.673412:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946813952 00000100:00100000:2.0:1777580319.673424:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946813952 00000100:00100000:2.0:1777580319.673489:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4271 00000100:00100000:2.0:1777580319.673501:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+124:283539:x1863919946813952:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.674101:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+125:283539:x1863919946813952:12345-192.168.202.9@tcp:35:touch.500 Request processed in 600us (917us total) trans 8589951104 rc 0/0 00000100:00100000:2.0:1777580319.674110:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4271 00000100:00100000:1.0:1777580319.674226:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946813568 00000100:00100000:1.0:1777580319.674234:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946813568 00000100:00100000:1.0:1777580319.674276:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12191 00000100:00100000:1.0:1777580319.674304:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946813568:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580319.674927:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2364:x1863919946813568:12345-192.168.202.9@tcp:2:touch.500 Request processed in 623us (1872us total) trans 8589939095 rc 0/0 00000100:00100000:1.0:1777580319.674934:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12191 00000100:00100000:3.0:1777580319.675415:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946813696 00000100:00100000:3.0:1777580319.675424:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946813696 00000100:00100000:3.0:1777580319.675462:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840617283858 time 7840617183858 state 0x1 ref 2 00000100:00100000:3.0:1777580319.675492:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840617283858 time 7840624354148 state 0x0 ref 2 00000100:00100000:3.0:1777580319.675504:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+125:283529:x1863919946813696:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.675537:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.675586:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4dbea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f00e expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.675648:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4dbea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x846:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f00e expref: 126 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.675666:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4dbea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x846:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f00e expref: 126 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.675687:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa02481358500) 00010000:00010000:3.0:1777580319.675689:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.675692:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7400, rc 0) 00000100:00100000:3.0:1777580319.679802:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283529:x1863919946813696:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4280us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.679818:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19972 00000100:00100000:3.0:1777580319.679877:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+125:283530:x1863919946813440:12345-192.168.202.9@tcp:101:touch.500 Request processed in 11544us (20847us total) trans 8589951103 rc 0/0 00000100:00100000:3.0:1777580319.679884:0:205909:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19971 00000100:00100000:3.0:1777580319.679891:0:205909:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840617283858 time 7840624354148 state 0x2 ref 0 00010000:00010000:0.0:1777580319.697065:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697088:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697115:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697122:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.697129:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697153:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697175:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa0249076fc00) 00010000:00010000:0.0:1777580319.697178:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.697185:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.697191:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dbd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.710334:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.710485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.721433:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946814208 00000100:00100000:3.0:1777580319.721455:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946814208 00000100:00100000:2.0:1777580319.721803:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.721892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.721955:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840617283858 time 7840624354148 state 0x0 ref 1 00000100:00100000:2.0:1777580319.721971:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840624454148 time 7840624354148 state 0x1 ref 1 00000100:00100000:2.0:1777580319.722009:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946814464 00000100:00100000:2.0:1777580319.722014:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946814464 00000100:00100000:2.0:1777580319.722029:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840624454148 time 7840624354148 state 0x1 ref 2 00000100:00100000:2.0:1777580319.722054:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671016434 time 7840670916434 state 0x1 ref 2 00000100:00100000:2.0:1777580319.722067:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+125:283530:x1863919946814208:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580319.722172:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580319.722208:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dbdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f007 expref: 125 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.722253:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024997a0d00) 00010000:00010000:2.0:1777580319.722269:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.722372:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.722387:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.722398:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.722787:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000519d73ca reply state 0000000063f6423d transno 8589951105 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.722798:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.722931:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+126:283530:x1863919946814208:12345-192.168.202.9@tcp:36:touch.500 Request processed in 864us (12611us total) trans 8589951105 rc 0/0 00000100:00100000:2.0:1777580319.722940:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19973 00000100:00100000:2.0:1777580319.722977:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671016434 time 7840671839320 state 0x0 ref 1 00000100:00100000:2.0:1777580319.722992:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+125:283531:x1863919946814464:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.723006:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.723022:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dbf8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f015 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723192:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723224:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723234:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723249:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723255:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.723261:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.723830:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946814848 00000100:00100000:3.0:1777580319.723841:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946814848 00000100:00100000:3.0:1777580319.723899:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4272 00000100:00100000:3.0:1777580319.723909:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+127:283528:x1863919946814848:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:1.0:1777580319.726901:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946814592 00000100:00100000:1.0:1777580319.726919:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946814592 00000100:00100000:1.0:1777580319.726992:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12192 00000100:00100000:1.0:1777580319.727004:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+27:2364:x1863919946814592:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580319.727479:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2364:x1863919946814592:12345-192.168.202.9@tcp:2:touch.500 Request processed in 475us (5584us total) trans 8589938695 rc 0/0 00000100:00100000:1.0:1777580319.727489:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12192 00000100:00100000:3.0:1777580319.728385:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+128:283528:x1863919946814848:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4476us (6587us total) trans 8589951106 rc 0/0 00000100:00100000:3.0:1777580319.728395:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4272 00000004:00080000:2.0:1777580319.729296:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15de:0x0], index 1: 0 00010000:00010000:2.0:1777580319.729517:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dc0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729539:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729727:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729790:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729798:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729805:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729827:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.729832:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729840:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729854:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.729857:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.729862:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729869:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dbff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.729885:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008e19c8a6 reply state 000000009e31d9ba transno 8589951107 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.729895:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580319.729941:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dbf8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f015 expref: 129 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729958:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dc0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f015 expref: 128 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.729967:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa024ad9fd000) 00010000:00010000:2.0:1777580319.729970:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.729972:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd000, rc 0) 00000100:00100000:2.0:1777580319.730214:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283531:x1863919946814464:12345-192.168.202.9@tcp:101:touch.500 Request processed in 7224us (19727us total) trans 8589951107 rc 0/0 00000100:00100000:2.0:1777580319.730234:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19974 00000100:00100000:2.0:1777580319.730244:0:187632:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671016434 time 7840671839320 state 0x2 ref 0 00000100:00100000:1.0:1777580319.740131:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580319.740197:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740213:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740221:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740228:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.740234:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740242:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740275:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024ad9fd500) 00010000:00010000:1.0:1777580319.740278:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.740285:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.740291:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dbf1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.740803:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946815104 00000100:00100000:2.0:1777580319.740820:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946815104 00000100:00100000:2.0:1777580319.740919:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4273 00000100:00100000:2.0:1777580319.740933:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+128:283529:x1863919946815104:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.741466:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283529:x1863919946815104:12345-192.168.202.9@tcp:35:touch.500 Request processed in 533us (1346us total) trans 8589951108 rc 0/0 00000100:00100000:2.0:1777580319.741475:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4273 00000100:00100000:1.0:1777580319.743901:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.751917:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946815232 00000100:00100000:2.0:1777580319.751939:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946815232 00000100:00100000:2.0:1777580319.751993:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671016434 time 7840671839320 state 0x0 ref 1 00000100:00100000:2.0:1777580319.752008:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671939320 time 7840671839320 state 0x1 ref 1 00000100:00100000:2.0:1777580319.752046:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671939320 time 7840700907844 state 0x0 ref 1 00000100:00100000:2.0:1777580319.752064:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+129:283530:x1863919946815232:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.752095:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.752126:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dc1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f01c expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.752238:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dc1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x847:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f01c expref: 130 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.752270:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dc1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x847:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f01c expref: 130 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.752293:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024ad9fd100) 00010000:00010000:2.0:1777580319.752297:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580319.752301:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fd600, rc 0) 00000100:00100000:2.0:1777580319.752389:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283530:x1863919946815232:12345-192.168.202.9@tcp:101:touch.500 Request processed in 332us (8502us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.752398:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19975 00000100:00100000:2.0:1777580319.752403:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671939320 time 7840700907844 state 0x2 ref 0 00010000:00010000:0.0:1777580319.757738:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757771:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757781:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757787:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fda00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.757793:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757818:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757839:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024ad9fd800) 00010000:00010000:0.0:1777580319.757842:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.757848:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.757855:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dc06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.767251:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.767348:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.767422:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946815488 00000100:00100000:3.0:1777580319.767434:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946815488 00000100:00100000:3.0:1777580319.767483:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840671939320 time 7840700907844 state 0x0 ref 1 00000100:00100000:3.0:1777580319.767500:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840701007844 time 7840700907844 state 0x1 ref 1 00000100:00100000:3.0:1777580319.767531:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946815744 00000100:00100000:3.0:1777580319.767534:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946815744 00000100:00100000:3.0:1777580319.767558:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840701007844 time 7840700907844 state 0x1 ref 2 00000100:00100000:3.0:1777580319.767678:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840716639416 time 7840716539416 state 0x1 ref 2 00000100:00100000:3.0:1777580319.767692:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283531:x1863919946815488:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580319.767790:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.767827:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dc0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f015 expref: 130 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.767850:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa024ad9fd000) 00010000:00010000:3.0:1777580319.767861:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.767960:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.767978:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.767989:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.768214:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000218170aa reply state 00000000b30e91ba transno 8589951109 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.768226:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.768344:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+131:283531:x1863919946815488:12345-192.168.202.9@tcp:36:touch.500 Request processed in 654us (1106us total) trans 8589951109 rc 0/0 00000100:00100000:3.0:1777580319.768354:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19976 00000100:00100000:3.0:1777580319.768379:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840716639416 time 7840717241851 state 0x0 ref 1 00000100:00100000:3.0:1777580319.768391:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+130:283535:x1863919946815744:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.768403:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.768416:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dc29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f023 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.768557:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.768568:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.773104:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.773161:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.773177:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.773199:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.774323:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:3.0:1777580319.774833:0:205914:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1603:0x0], index 0: 0 00010000:00010000:3.0:1777580319.775075:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dc3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.775091:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.775103:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dc3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.775187:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.775195:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.775297:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946815872 00000100:00100000:2.0:1777580319.775309:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946815872 00000100:00100000:2.0:1777580319.775370:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12193 00000100:00100000:2.0:1777580319.775381:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2361:x1863919946815872:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580319.775830:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946815872:12345-192.168.202.9@tcp:2:touch.500 Request processed in 449us (1515us total) trans 8589939096 rc 0/0 00000100:00100000:2.0:1777580319.775839:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12193 00010000:00010000:3.0:1777580319.778033:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778042:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.778048:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778060:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778081:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.778084:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.778107:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778115:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4dc30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.778153:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000654b560b reply state 00000000fbcc781f transno 8589951110 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.778165:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.778235:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4dc29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f023 expref: 133 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778254:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dc3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f023 expref: 132 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.778262:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02499479000) 00010000:00010000:3.0:1777580319.778264:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.778267:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4da00, rc 0) 00000100:00100000:3.0:1777580319.778355:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+133:283535:x1863919946815744:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9964us (11004us total) trans 8589951110 rc 0/0 00000100:00100000:3.0:1777580319.778368:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19977 00000100:00100000:3.0:1777580319.778378:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840716639416 time 7840717241851 state 0x2 ref 0 00010000:00010000:1.0:1777580319.778686:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778696:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778702:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778707:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.778711:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778717:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778726:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa024996f9e00) 00010000:00010000:1.0:1777580319.778728:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.778730:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.778747:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4dc22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.785249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.785346:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946816000 00000100:00100000:3.0:1777580319.785360:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946816000 00000100:00100000:3.0:1777580319.785412:0:187630:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840716639416 time 7840717241851 state 0x0 ref 1 00000100:00100000:3.0:1777580319.785429:0:187630:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840717341851 time 7840717241851 state 0x1 ref 1 00000100:00100000:3.0:1777580319.785466:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840717341851 time 7840734328466 state 0x0 ref 1 00000100:00100000:3.0:1777580319.785498:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+132:283531:x1863919946816000:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.785533:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.785564:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dc4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f02a expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.785756:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dc4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x848:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f02a expref: 133 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.785786:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dc4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x848:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f02a expref: 133 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.785809:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580319.785813:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.785817:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4d200, rc 0) 00000100:00100000:3.0:1777580319.785905:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+133:283531:x1863919946816000:12345-192.168.202.9@tcp:101:touch.500 Request processed in 409us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.785914:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19978 00000100:00100000:3.0:1777580319.785921:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840717341851 time 7840734328466 state 0x2 ref 0 00010000:00010000:1.0:1777580319.800078:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800102:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800111:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800119:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.800125:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800146:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800171:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa024996f9800) 00010000:00010000:1.0:1777580319.800174:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.800180:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.800187:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4dc37 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.802641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.802691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.802721:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.802743:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.807199:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946816640 00000100:00100000:1.0:1777580319.807219:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946816640 00000100:00100000:1.0:1777580319.807303:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12194 00000100:00100000:1.0:1777580319.807316:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946816640:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580319.807988:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946816640:12345-192.168.202.9@tcp:2:touch.500 Request processed in 671us (5260us total) trans 8589938696 rc 0/0 00000100:00100000:1.0:1777580319.807999:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12194 00000100:00100000:3.0:1777580319.809945:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946816256 00000100:00100000:3.0:1777580319.809960:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946816256 00000100:00100000:3.0:1777580319.810017:0:191688:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840717341851 time 7840734328466 state 0x0 ref 1 00000100:00100000:3.0:1777580319.810034:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840734428466 time 7840734328466 state 0x1 ref 1 00000100:00100000:3.0:1777580319.810065:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946816512 00000100:00100000:3.0:1777580319.810069:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946816512 00000100:00100000:3.0:1777580319.810105:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840734428466 time 7840734328466 state 0x1 ref 2 00000100:00100000:0.0:1777580319.810191:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840759150963 time 7840759050963 state 0x1 ref 2 00000100:00100000:0.0:1777580319.810214:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+133:283535:x1863919946816256:12345-192.168.202.9@tcp:36:touch.500 00000100:00100000:3.0:1777580319.810243:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7840759150963 time 7840759105427 state 0x0 ref 2 00000100:00100000:3.0:1777580319.810255:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+133:283538:x1863919946816512:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.810267:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.810297:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.810307:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4dc53 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f031 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.810327:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dc3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f023 expref: 134 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.810342:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02499479000) 00010000:00010000:0.0:1777580319.810354:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580319.810438:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.810453:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810459:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.810464:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810470:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810490:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810502:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810508:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.810514:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580319.810736:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000224a93e3 reply state 00000000e1cb1c41 transno 8589951111 ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.810748:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580319.810897:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+135:283535:x1863919946816256:12345-192.168.202.9@tcp:36:touch.500 Request processed in 690us (8266us total) trans 8589951111 rc 0/0 00000100:00100000:0.0:1777580319.810905:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19979 00000004:00080000:3.0:1777580319.811076:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15df:0x0], index 1: 0 00010000:00010000:3.0:1777580319.814468:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dc6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814522:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814539:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dc6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814595:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814603:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814611:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814618:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.814625:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814634:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814648:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.814652:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.814658:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814664:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dc61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.814679:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f048d40a reply state 0000000013017eba transno 8589951112 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.814697:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580319.814753:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ca00/0xcb2b2f2f7e4dc53 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f031 expref: 136 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814784:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dc6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f031 expref: 135 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.814793:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580319.814794:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.814797:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4f800, rc 0) 00000100:00100000:3.0:1777580319.814915:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283538:x1863919946816512:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4659us (12167us total) trans 8589951112 rc 0/0 00000100:00100000:3.0:1777580319.814926:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19980 00000100:00100000:3.0:1777580319.814937:0:191688:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7840759150963 time 7840759105427 state 0x2 ref 0 00000100:00100000:3.0:1777580319.815007:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946816896 00000100:00100000:3.0:1777580319.815019:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946816896 00000100:00100000:3.0:1777580319.815792:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4274 00000100:00100000:3.0:1777580319.815808:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283530:x1863919946816896:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580319.816057:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.816164:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816175:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816181:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816187:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.816190:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816197:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816211:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa0248a60e800) 00010000:00010000:0.0:1777580319.816214:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.816218:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.816224:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dc5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.816279:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817152 00000100:00100000:0.0:1777580319.816287:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817152 00000100:00100000:0.0:1777580319.816319:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4275 00000100:00100000:0.0:1777580319.816327:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283531:x1863919946817152:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580319.816867:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+138:283531:x1863919946817152:12345-192.168.202.9@tcp:35:touch.500 Request processed in 537us (807us total) trans 8589951114 rc 0/0 00000100:00100000:0.0:1777580319.816876:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4275 00000100:00100000:3.0:1777580319.817716:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283530:x1863919946816896:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1909us (15018us total) trans 8589951113 rc 0/0 00000100:00100000:3.0:1777580319.817725:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4274 00010000:00010000:0.0:1777580319.820166:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820186:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820195:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820203:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.820209:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820218:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820239:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02499479900) 00010000:00010000:0.0:1777580319.820243:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.820247:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.820254:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dc68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.823531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.823672:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817280 00000100:00100000:3.0:1777580319.823685:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817280 00000100:00100000:3.0:1777580319.823745:0:205914:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7840759150963 time 7840759105427 state 0x0 ref 1 00000100:00100000:3.0:1777580319.823777:0:205914:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 1 deadline 7840759205427 time 7840759105427 state 0x1 ref 1 00000100:00100000:3.0:1777580319.823807:0:205914:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840759205427 time 7840772669042 state 0x0 ref 1 00000100:00100000:3.0:1777580319.823821:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+136:283535:x1863919946817280:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.823857:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.823890:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4dc7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f038 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.823963:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4dc7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x849:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f038 expref: 137 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.823980:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4dc7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x849:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f038 expref: 137 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.824001:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02499479000) 00010000:00010000:3.0:1777580319.824005:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.824008:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50e00, rc 0) 00000100:00100000:3.0:1777580319.824074:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+137:283535:x1863919946817280:12345-192.168.202.9@tcp:101:touch.500 Request processed in 256us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.824082:0:205914:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19981 00000100:00100000:3.0:1777580319.824088:0:205914:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840759205427 time 7840772669042 state 0x2 ref 0 00000100:00100000:2.0:1777580319.835363:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.835409:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.835435:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.835660:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817536 00000100:00100000:2.0:1777580319.835674:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817536 00000100:00100000:2.0:1777580319.835728:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840759205427 time 7840772669042 state 0x0 ref 1 00000100:00100000:2.0:1777580319.835747:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840772769042 time 7840772669042 state 0x1 ref 1 00000100:00100000:2.0:1777580319.840380:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817664 00000100:00100000:2.0:1777580319.840404:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817664 00000100:00100000:2.0:1777580319.840462:0:187632:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840239014450 time 7840254154906 state 0x0 ref 1 00000100:00100000:2.0:1777580319.840491:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840254254906 time 7840254154906 state 0x1 ref 1 00000100:00100000:2.0:1777580319.840509:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817792 00000100:00100000:2.0:1777580319.840513:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817792 00000100:00100000:2.0:1777580319.840523:0:187632:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840254254906 time 7840254154906 state 0x1 ref 2 00000100:00100000:2.0:1777580319.840546:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789508077 time 7840789408077 state 0x1 ref 2 00000100:00100000:3.0:1777580319.840597:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840772769042 time 7840789457224 state 0x0 ref 1 00000100:00100000:3.0:1777580319.840620:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283538:x1863919946817536:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580319.841028:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.841074:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dc6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f031 expref: 139 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.841098:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580319.841111:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.841234:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.841251:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.841262:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.841473:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000005635540 reply state 00000000ac885531 transno 8589951115 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.841486:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.841636:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283538:x1863919946817536:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1024us (6283us total) trans 8589951115 rc 0/0 00000100:00100000:3.0:1777580319.841645:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19982 00000100:00100000:3.0:1777580319.841651:0:187630:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840772769042 time 7840789457224 state 0x2 ref 0 00000100:00100000:3.0:1777580319.841690:0:187630:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789508077 time 7840790553092 state 0x0 ref 2 00000100:00100000:3.0:1777580319.841703:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+139:283557:x1863919946817792:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.841716:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.841973:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dc8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f046 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842056:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842067:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842077:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842091:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842097:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842103:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842278:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842287:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842294:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580319.842324:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x844:0x0]: returning size 0 00000004:00200000:3.0:1777580319.842329:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1777580319.842390:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+140:283552:x1863919946817664:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.842403:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.842418:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4dca7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f03f expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842452:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842461:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842469:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842494:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842501:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.842517:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.842599:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842625:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842634:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842641:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842648:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842655:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.842659:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842668:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842679:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.842683:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.842687:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842694:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4dc92 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842710:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842716:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842728:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842744:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.842747:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842753:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842770:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02493ac1e00) 00010000:00010000:3.0:1777580319.842773:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.842776:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842782:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dc99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842818:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dc8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f046 expref: 142 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842831:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f046 expref: 141 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.842839:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024c6346000) 00010000:00010000:3.0:1777580319.842841:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.842844:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51200, rc 0) 00000100:00100000:3.0:1777580319.842903:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+141:283557:x1863919946817792:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1204us (7466us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.842920:0:187630:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19984 00000100:00100000:3.0:1777580319.843094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.843223:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.843287:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580319.843295:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843311:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580319.843322:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843336:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00200000:2.0:1777580319.843354:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x843:0x0]: returning size 0 00000004:00200000:2.0:1777580319.843358:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580319.843376:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843386:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843394:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843397:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946817920 00010000:00010000:2.0:1777580319.843400:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843406:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843409:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946817920 00010000:00010000:2.0:1777580319.843411:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.843413:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843426:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843436:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.843438:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.843441:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843446:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dcae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843454:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840790653092 time 7840790553092 state 0x1 ref 2 00010000:00010000:2.0:1777580319.843457:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843463:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843467:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818176 00000100:00100000:3.0:1777580319.843470:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818176 00010000:00010000:2.0:1777580319.843470:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.843478:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840790653092 time 7840790553092 state 0x1 ref 3 00000100:00100000:3.0:1777580319.843486:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818304 00000100:00100000:3.0:1777580319.843488:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818304 00000100:00100000:3.0:1777580319.843497:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840790653092 time 7840790553092 state 0x1 ref 4 00000100:00100000:3.0:1777580319.843503:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818432 00000100:00100000:3.0:1777580319.843505:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818432 00000100:00100000:3.0:1777580319.843514:0:191688:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840790653092 time 7840790553092 state 0x1 ref 5 00000100:00100000:3.0:1777580319.843526:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840792488600 time 7840792388600 state 0x1 ref 5 00000100:00100000:3.0:1777580319.843536:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283563:x1863919946817920:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.843550:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.843564:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4dcc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f04d expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843626:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843635:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843643:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843656:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843663:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843669:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843681:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.843685:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843691:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843699:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa024ad9fdf00) 00010000:00010000:2.0:1777580319.843702:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.843705:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843717:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dcb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843746:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4dca7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f03f expref: 146 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843752:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843759:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f03f expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843772:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843780:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843780:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa024993df900) 00010000:00010000:2.0:1777580319.843782:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.843785:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fda00, rc 0) 00000004:00200000:3.0:1777580319.843799:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x846:0x0]: returning size 0 00000004:00200000:3.0:1777580319.843801:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580319.843811:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843830:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.843833:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283552:x1863919946817664:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3277us (8423us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580319.843838:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.843840:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19983 00010000:00010000:3.0:1777580319.843844:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843849:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843854:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02396b20600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.843857:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843863:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.843863:0:187632:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840792826722 time 7840792726722 state 0x1 ref 4 00010000:00010000:3.0:1777580319.843872:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00000100:00100000:2.0:1777580319.843873:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283546:x1863919946818176:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.843874:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.843877:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843881:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.843883:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4dcca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843888:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dcdf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f054 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843894:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843900:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843912:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843913:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843919:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02396b20800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.843922:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843922:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843929:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843937:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02493ac1a00) 00010000:00010000:2.0:1777580319.843939:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843940:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.843942:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843948:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4dcd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843951:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843957:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.843963:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843968:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4dcc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f04d expref: 146 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843979:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f04d expref: 145 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.843985:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa02481358500) 00010000:00010000:3.0:1777580319.843988:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.843990:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1c00, rc 0) 00010000:00010000:2.0:1777580319.844011:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.844012:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283563:x1863919946817920:12345-192.168.202.9@tcp:101:rm.500 Request processed in 477us (919us total) trans 0 rc 0/0 00010000:00010000:2.0:1777580319.844020:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.844027:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.844028:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19985 00000100:00100000:3.0:1777580319.844043:0:191688:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840793006070 time 7840792906070 state 0x1 ref 3 00000004:00200000:2.0:1777580319.844046:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x842:0x0]: returning size 0 00000004:00200000:2.0:1777580319.844048:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1777580319.844052:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283560:x1863919946818304:12345-192.168.202.9@tcp:101:rm.500 00000004:00010000:2.0:1777580319.844056:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844059:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.844064:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844067:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dcfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f05b expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.844071:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844090:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.844653:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840793006070 time 7840793512975 state 0x0 ref 3 00000100:00100000:0.0:1777580319.844671:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283542:x1863919946818432:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580319.844681:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.844692:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dd09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f062 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.844727:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.844772:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.844778:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844907:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844917:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844932:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844938:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.844944:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846600:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846622:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846651:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580319.846694:0:191688:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x845:0x0]: returning size 0 00000004:00200000:3.0:1777580319.846699:0:191688:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580319.846724:0:191688:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846940:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846952:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846959:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846966:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846973:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.846977:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846985:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.846998:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580319.847002:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.847007:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847024:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4dd02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847041:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847048:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847054:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847060:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.847063:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847069:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847077:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02493ac1500) 00010000:00010000:3.0:1777580319.847079:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.847082:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847087:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dd17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847161:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dcfb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f05b expref: 147 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847193:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f05b expref: 146 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.847201:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:3.0:1777580319.847204:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580319.847206:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0000, rc 0) 00000100:00100000:3.0:1777580319.847286:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023985f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+146:283560:x1863919946818304:12345-192.168.202.9@tcp:101:rm.500 Request processed in 3232us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.847296:0:191688:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19987 00000100:00100000:3.0:1777580319.850196:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.850379:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850403:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850439:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850448:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850454:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.850455:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850463:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850472:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850498:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.850501:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.850506:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850514:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4dce6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850532:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850539:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850546:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850552:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.850573:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850579:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850586:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024ad9fd000) 00010000:00010000:2.0:1777580319.850589:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.850591:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850596:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4a00/0xcb2b2f2f7e4dced lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850618:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850626:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850640:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850645:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dcdf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f054 expref: 146 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850660:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f054 expref: 145 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.850668:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:2.0:1777580319.850670:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.850672:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4400, rc 0) 00000004:00200000:0.0:1777580319.850674:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x841:0x0]: returning size 0 00000004:00200000:0.0:1777580319.850679:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580319.850701:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850714:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850720:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.850726:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.850740:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02383e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283546:x1863919946818176:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6867us (7451us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.850751:0:187632:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19986 00010000:00010000:0.0:1777580319.851062:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851070:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.851073:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851080:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851089:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580319.851092:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.851094:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851114:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4dd10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851155:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851163:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851169:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851174:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d9200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.851177:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851184:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851192:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa0248a60e800) 00010000:00010000:0.0:1777580319.851195:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.851198:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851204:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4dd25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851232:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dd09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f062 expref: 145 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851256:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f062 expref: 144 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.851263:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:0.0:1777580319.851265:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580319.851267:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8400, rc 0) 00000100:00100000:0.0:1777580319.851297:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02395cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283542:x1863919946818432:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6631us (7959us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580319.851304:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19988 00000100:00100000:0.0:1777580319.851312:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840793006070 time 7840793512975 state 0x2 ref 0 00000100:00100000:3.0:1777580319.851807:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.855335:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818688 00000100:00100000:0.0:1777580319.855365:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818688 00000100:00100000:0.0:1777580319.855417:0:207396:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840772769042 time 7840789457224 state 0x0 ref 1 00000100:00100000:0.0:1777580319.855432:0:207396:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789557224 time 7840789457224 state 0x1 ref 1 00000100:00100000:0.0:1777580319.855466:0:207396:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789557224 time 7840804328125 state 0x0 ref 1 00000100:00100000:0.0:1777580319.855485:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283538:x1863919946818688:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580319.855519:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.855688:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4dd33 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f070 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.855786:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818048 00000100:00100000:2.0:1777580319.855792:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818048 00000100:00100000:2.0:1777580319.855828:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818560 00000100:00100000:2.0:1777580319.855832:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818560 00010000:00010000:0.0:1777580319.855874:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4dd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f070 expref: 145 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.855877:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12195 00000100:00100000:2.0:1777580319.855886:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2361:x1863919946818048:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:0.0:1777580319.855904:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4dd33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f070 expref: 145 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.855929:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479900) 00010000:00010000:0.0:1777580319.855933:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777580319.855937:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d8800, rc 0) 00000100:00100000:0.0:1777580319.856017:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023863a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283538:x1863919946818688:12345-192.168.202.9@tcp:101:touch.500 Request processed in 541us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580319.856026:0:207396:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19989 00000100:00100000:0.0:1777580319.856031:0:207396:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789557224 time 7840804328125 state 0x2 ref 0 00010000:00010000:0.0:1777580319.856085:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856095:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856102:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856108:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.856114:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856121:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856207:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479900) 00010000:00010000:0.0:1777580319.856218:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.856223:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.856230:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dc84 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.856446:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239248b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2361:x1863919946818048:12345-192.168.202.9@tcp:2:touch.500 Request processed in 560us (13221us total) trans 8589939097 rc 0/0 00000100:00100000:2.0:1777580319.856453:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12195 00000100:00100000:2.0:1777580319.856469:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12196 00000100:00100000:2.0:1777580319.856601:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2363:x1863919946818560:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.856615:0:188246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.856632:0:188246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f069 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580319.856658:0:188246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15dc:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:2.0:1777580319.856674:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.856676:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.856685:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 30 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.856701:0:188246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 30 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.856712:0:188246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e5600, rc 0) 00000100:00100000:2.0:1777580319.856734:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2363:x1863919946818560:12345-192.168.202.9@tcp:101:rm.500 Request processed in 258us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.856741:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12196 00000100:00100000:2.0:1777580319.856859:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.856997:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818944 00000100:00100000:0.0:1777580319.857005:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818944 00000100:00100000:0.0:1777580319.857045:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12197 00000100:00100000:0.0:1777580319.857053:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:2363:x1863919946818944:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580319.857062:0:206021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.857078:0:206021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f07e expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580319.857450:0:206021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15db:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:0.0:1777580319.857465:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580319.857467:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580319.857473:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 31 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.857488:0:206021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 31 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.857499:0:206021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023a95d9800, rc 0) 00000100:00100000:0.0:1777580319.857640:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2363:x1863919946818944:12345-192.168.202.9@tcp:101:rm.500 Request processed in 488us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580319.857649:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12197 00000100:00100000:2.0:1777580319.863588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.864263:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819072 00000100:00100000:0.0:1777580319.864278:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819072 00000100:00100000:0.0:1777580319.864356:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12198 00000100:00100000:0.0:1777580319.864366:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+31:2364:x1863919946819072:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580319.866063:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946819072:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1687us (2478us total) trans 8589938697 rc 0/0 00000100:00100000:0.0:1777580319.866077:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12198 00000100:00100000:0.0:1777580319.867924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.867974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.867999:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.868023:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.868049:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.868085:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.868119:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819200 00000100:00100000:0.0:1777580319.868189:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819200 00000100:00100000:0.0:1777580319.868247:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946818816 00000100:00100000:0.0:1777580319.868251:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946818816 00000100:00100000:0.0:1777580319.868269:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819456 00000100:00100000:0.0:1777580319.868272:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819456 00000100:00100000:0.0:1777580319.868288:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819328 00000100:00100000:0.0:1777580319.868289:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819328 00000100:00100000:0.0:1777580319.868316:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12199 00000100:00100000:0.0:1777580319.868328:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2364:x1863919946819200:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:3.0:1777580319.869887:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12200 00000100:00100000:3.0:1777580319.869913:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946818816:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:2.0:1777580319.869915:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12201 00000100:00100000:2.0:1777580319.869927:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946819456:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580319.869940:0:205897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.869940:0:206020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.869967:0:205897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f077 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.869967:0:206020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f093 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580319.870004:0:205897:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1600:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00002000:00010000:2.0:1777580319.870004:0:206020:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x15ff:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:3.0:1777580319.870030:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.870030:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580319.870033:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.870033:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580319.870044:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.870044:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 34 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.870064:0:205897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 34 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.870064:0:206020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 34 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.870080:0:206020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4a00, rc 0) 00010000:00010000:3.0:1777580319.870090:0:205897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1600, rc 0) 00010000:00010000:0.0:1777580319.870169:0:188247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.870184:0:188247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f085 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777580319.870200:0:188247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1601:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:0.0:1777580319.870219:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580319.870220:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580319.870226:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 35 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.870237:0:188247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 35 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.870246:0:188247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4ca00, rc 0) 00000100:00100000:2.0:1777580319.871490:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946819456:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1544us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.871502:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12201 00000100:00100000:2.0:1777580319.871547:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12202 00000100:00100000:2.0:1777580319.871560:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:2362:x1863919946819328:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580319.871576:0:206020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.871599:0:206020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f08c expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580319.871645:0:206020:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15dd:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:2.0:1777580319.871663:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.871665:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580319.871672:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 33 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.871689:0:206020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 33 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.871703:0:206020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4c00, rc 0) 00000100:00100000:2.0:1777580319.871746:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2362:x1863919946819328:12345-192.168.202.9@tcp:101:rm.500 Request processed in 191us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580319.871753:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12202 00000100:00100000:2.0:1777580319.871795:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819968 00000100:00100000:2.0:1777580319.871805:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819968 00000100:00100000:2.0:1777580319.871858:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4276 00000100:00100000:2.0:1777580319.871865:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+144:283535:x1863919946819968:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.872298:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283535:x1863919946819968:12345-192.168.202.9@tcp:35:touch.500 Request processed in 431us (4210us total) trans 8589951116 rc 0/0 00000100:00100000:2.0:1777580319.872307:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4276 00000100:00100000:3.0:1777580319.875219:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b568f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946818816:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5302us (7227us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.875235:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12200 00000100:00100000:1.0:1777580319.877874:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946819712 00000100:00100000:1.0:1777580319.877893:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946819712 00000100:00100000:1.0:1777580319.877945:0:188495:0:(nrs_tbf.c:1263:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840789557224 time 7840804328125 state 0x0 ref 1 00000100:00100000:1.0:1777580319.877962:0:188495:0:(nrs_tbf.c:2359:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840804428125 time 7840804328125 state 0x1 ref 1 00000100:00100000:1.0:1777580319.877994:0:188495:0:(nrs_tbf.c:2283:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840804428125 time 7840826855237 state 0x0 ref 1 00000100:00100000:1.0:1777580319.878013:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+145:283544:x1863919946819712:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580319.878041:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580319.878067:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4dd64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f09a expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878283:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878303:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878317:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878359:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878368:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.878375:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580319.880054:0:188495:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1604:0x0], index 0: 0 00010000:00010000:1.0:1777580319.880329:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4dd79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.881022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580319.881454:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4dd79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881472:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4dd79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881886:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881897:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881904:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881910:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.881915:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881943:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881959:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580319.881962:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.881968:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.881975:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4dd6b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580319.881989:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000078837916 reply state 000000004320c3e4 transno 8589951117 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.881999:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580319.882062:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4dd64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f09a expref: 148 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.882080:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4dd79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f09a expref: 147 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.882088:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02427669900) 00010000:00010000:1.0:1777580319.882090:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580319.882093:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:1.0:1777580319.882173:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283544:x1863919946819712:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4166us (14121us total) trans 8589951117 rc 0/0 00000100:00100000:1.0:1777580319.882183:0:188495:0:(nrs_tbf.c:2414:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.9@tcp, seq: 19990 00000100:00100000:1.0:1777580319.882194:0:188495:0:(nrs_tbf.c:1243:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840804428125 time 7840826855237 state 0x2 ref 0 00000100:00100000:0.0:1777580319.882474:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946819200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 14146us (14560us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580319.882484:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12199 00000100:00100000:3.0:1777580319.883050:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946820224 00000100:00100000:3.0:1777580319.883063:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946820224 00000100:00100000:3.0:1777580319.883131:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4277 00000100:00100000:3.0:1777580319.883172:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283538:x1863919946820224:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:3.0:1777580319.885672:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+149:283538:x1863919946820224:12345-192.168.202.9@tcp:35:touch.500 Request processed in 2488us (4643us total) trans 8589951118 rc 0/0 00000100:00100000:3.0:1777580319.885688:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4277 00000100:00100000:1.0:1777580319.886919:0:209556:0:(nrs_tbf.c:531:nrs_tbf_cli_fini()) mdt.0 NRS: TBF class fini: class@ffffa0248308ca00 key jobid={rm.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840793006070 time 7840793512975 state 0x6 ref 0 00000100:00100000:1.0:1777580319.886938:0:209556:0:(nrs_tbf.c:531:nrs_tbf_cli_fini()) mdt.0 NRS: TBF class fini: class@ffffa0248aefa300 key jobid={touch.500} rule@0xffffa0248aefad00 gen 0 rate 10000 depth 3 token 2 deadline 7840804428125 time 7840826855237 state 0x6 ref 0 00010000:00010000:1.0:1777580319.893002:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893026:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893034:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893040:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.893046:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893055:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893076:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02427669a00) 00010000:00010000:1.0:1777580319.893080:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.893086:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.893092:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4dd72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.904857:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.905596:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946820736 00000100:00100000:0.0:1777580319.905611:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946820736 00000100:00100000:0.0:1777580319.905683:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 814 00000100:00100000:0.0:1777580319.905695:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283547:x1863919946820736:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:0.0:1777580319.905746:0:191688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580319.905781:0:191688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dd87 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0a1 expref: -99 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.905985:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.906004:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.906018:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.906054:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.906062:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.906068:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.906768:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:0.0:1777580319.907125:0:191688:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e0:0x0], index 1: 0 00010000:00010000:0.0:1777580319.907882:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dd9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907903:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907917:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dd9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907971:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907979:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907985:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.907991:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.907996:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.908022:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.908037:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580319.908040:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.908045:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.908051:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dd8e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580319.908415:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a5780f2d reply state 000000001d91a56e transno 8589951119 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.908427:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580319.908483:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dd87 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a1 expref: 151 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.908503:0:191688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dd9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a1 expref: 150 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.908510:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa02488b77500) 00010000:00010000:0.0:1777580319.908513:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580319.908515:0:191688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51800, rc 0) 00000100:00100000:0.0:1777580319.908720:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249dc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283547:x1863919946820736:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3026us (3874us total) trans 8589951119 rc 0/0 00000100:00100000:0.0:1777580319.908836:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 814 00000100:00100000:1.0:1777580319.912063:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580319.912187:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912209:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912218:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912225:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4d400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580319.912230:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912239:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912258:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02488b77200) 00010000:00010000:0.0:1777580319.912262:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580319.912267:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580319.912273:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dd95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.913222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580319.913267:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946820480 00000100:00100000:1.0:1777580319.913280:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946820480 00000100:00100000:0.0:1777580319.913496:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946820992 00000100:00100000:0.0:1777580319.913503:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946820992 00000100:00100000:3.0:1777580319.913659:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946821248 00000100:00100000:3.0:1777580319.913665:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946821248 00000100:00100000:2.0:1777580319.913785:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 815 00000100:00100000:2.0:1777580319.913800:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:283547:x1863919946820992:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580319.913904:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580319.913942:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dd9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a1 expref: 152 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.913962:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580319.913970:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.914060:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.914075:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.914086:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.914093:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 816 00000100:00100000:1.0:1777580319.914102:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+151:283544:x1863919946820480:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:1.0:1777580319.914124:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580319.914171:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4dd79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f09a expref: 151 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914183:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02427669900) 00010000:00010000:1.0:1777580319.914190:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580319.914217:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914226:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914232:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.914291:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000078b782e1 reply state 00000000e3bd3861 transno 8589951120 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.914302:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580319.914423:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239ce09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:283547:x1863919946820992:12345-192.168.202.9@tcp:36:touch.500 Request processed in 626us (2373us total) trans 8589951120 rc 0/0 00000100:00100000:2.0:1777580319.914431:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 815 00000004:00010000:1.0:1777580319.914432:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003bb63a72 reply state 00000000a6d42113 transno 8589951121 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.914439:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580319.914531:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+153:283544:x1863919946820480:12345-192.168.202.9@tcp:36:touch.500 Request processed in 431us (7774us total) trans 8589951121 rc 0/0 00000100:00100000:1.0:1777580319.914538:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 816 00000100:00100000:1.0:1777580319.914567:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 817 00000100:00100000:1.0:1777580319.914577:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+152:283548:x1863919946821248:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:1.0:1777580319.914597:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580319.914609:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ddb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0a8 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914740:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914752:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914769:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914783:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914789:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.914795:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580319.916237:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1605:0x0], index 0: 0 00010000:00010000:1.0:1777580319.916499:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4ddcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916516:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4ddcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916528:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4ddcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916596:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916604:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916611:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916618:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.916622:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916631:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916644:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580319.916647:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.916653:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916660:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4ddbf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580319.916676:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000e948eb4 reply state 000000002976e3f2 transno 8589951122 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.916685:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580319.916730:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4ddb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a8 expref: 155 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916785:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4ddcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a8 expref: 154 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.916793:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa02427669600) 00010000:00010000:1.0:1777580319.916796:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580319.916798:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8aa00, rc 0) 00000100:00100000:1.0:1777580319.916899:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283548:x1863919946821248:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2322us (3684us total) trans 8589951122 rc 0/0 00000100:00100000:1.0:1777580319.916909:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 817 00000100:00100000:3.0:1777580319.921632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.921662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580319.921693:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921708:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921717:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921724:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.921736:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921767:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921788:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02427669000) 00010000:00010000:3.0:1777580319.921792:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.921797:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.921804:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4ddb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.921850:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946821376 00000100:00100000:3.0:1777580319.921862:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946821376 00000100:00100000:3.0:1777580319.921912:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946821504 00000100:00100000:3.0:1777580319.921915:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946821504 00000100:00100000:3.0:1777580319.921939:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 818 00000100:00100000:3.0:1777580319.921949:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283547:x1863919946821376:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.921982:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.921991:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.921999:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922001:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dddb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0af expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.922006:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.922011:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.922021:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.922027:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.922037:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580319.922040:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.922042:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.922047:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4ddaa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922070:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dddb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0af expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922086:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dddb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0af expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922108:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:3.0:1777580319.922119:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.922123:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0e00, rc 0) 00000100:00100000:3.0:1777580319.922239:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283547:x1863919946821376:12345-192.168.202.9@tcp:101:touch.500 Request processed in 290us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.922246:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 818 00000100:00100000:3.0:1777580319.922268:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 819 00000100:00100000:3.0:1777580319.922275:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283544:x1863919946821504:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580319.922283:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580319.922294:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dde2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0b6 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922318:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dde2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0b6 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922329:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dde2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0b6 expref: 155 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.922339:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02493ac1500) 00010000:00010000:3.0:1777580319.922341:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580319.922344:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0c00, rc 0) 00000100:00100000:3.0:1777580319.922363:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+155:283544:x1863919946821504:12345-192.168.202.9@tcp:101:touch.500 Request processed in 90us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580319.922370:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 819 00000100:00100000:1.0:1777580319.926334:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.926768:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946821760 00000100:00100000:2.0:1777580319.926782:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946821760 00000100:00100000:2.0:1777580319.926845:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12203 00000100:00100000:2.0:1777580319.926855:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2364:x1863919946821760:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580319.927258:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2364:x1863919946821760:12345-192.168.202.9@tcp:2:touch.500 Request processed in 403us (937us total) trans 8589939098 rc 0/0 00000100:00100000:2.0:1777580319.927267:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12203 00010000:00010000:3.0:1777580319.929897:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.929928:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.929967:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.929974:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.929981:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.929989:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.930014:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02427669b00) 00010000:00010000:3.0:1777580319.930018:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.930024:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.930031:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4ddc6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.932613:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580319.932668:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.932794:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946822144 00000100:00100000:2.0:1777580319.932807:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946822144 00000100:00100000:2.0:1777580319.932879:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 820 00000100:00100000:2.0:1777580319.932892:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+154:283551:x1863919946822144:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580319.932924:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580319.932951:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dde9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0bd expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933211:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933230:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933243:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933260:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933267:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.933274:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580319.933924:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e1:0x0], index 1: 0 00010000:00010000:2.0:1777580319.934160:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4ddfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934173:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4ddfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934184:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4ddfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934231:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934252:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934259:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934266:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580319.934271:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934279:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934301:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580319.934304:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580319.934309:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934315:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4ddf0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580319.934329:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003192b34b reply state 0000000035fc4faf transno 8589951123 ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.934339:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777580319.934382:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4dde9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0bd expref: 157 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934399:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4ddfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0bd expref: 156 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.934422:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580319.934424:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580319.934427:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023937fc600, rc 0) 00000100:00100000:2.0:1777580319.934523:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:283551:x1863919946822144:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1633us (1921us total) trans 8589951123 rc 0/0 00000100:00100000:2.0:1777580319.934533:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 820 00000100:00100000:0.0:1777580319.937300:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946821632 00000100:00100000:0.0:1777580319.937322:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946821632 00000100:00100000:0.0:1777580319.937424:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12204 00000100:00100000:0.0:1777580319.937437:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:2361:x1863919946821632:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580319.939236:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2361:x1863919946821632:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1786us (6551us total) trans 8589938698 rc 0/0 00000100:00100000:0.0:1777580319.939275:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12204 00000100:00100000:2.0:1777580319.942056:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.942799:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.944430:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946822272 00000100:00100000:2.0:1777580319.944446:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946822272 00000100:00100000:2.0:1777580319.944876:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 821 00000100:00100000:2.0:1777580319.944990:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+157:283548:x1863919946822272:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:2.0:1777580319.945071:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580319.945249:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8aa00/0xcb2b2f2f7e4ddcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0a8 expref: 157 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.945271:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa02427669600) 00010000:00010000:2.0:1777580319.945285:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580319.945382:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.945399:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580319.945411:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580319.946519:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946822528 00000100:00100000:0.0:1777580319.946531:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946822528 00000004:00010000:2.0:1777580319.946754:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000095341657 reply state 000000007ff35707 transno 8589951124 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580319.946776:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580319.949695:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4278 00000100:00100000:0.0:1777580319.949710:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283544:x1863919946822528:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580319.954202:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580319.954249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580319.959391:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959414:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959423:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959429:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.959461:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959471:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959493:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa0249dea8500) 00010000:00010000:3.0:1777580319.959497:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.959503:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959510:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4ddf7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.959742:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946822784 00000100:00100000:3.0:1777580319.959756:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946822784 00000100:00100000:3.0:1777580319.959851:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 822 00000100:00100000:3.0:1777580319.959864:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+159:283551:x1863919946822784:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580319.959946:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580319.959969:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4ddfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0bd expref: 159 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.959983:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580319.959995:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580319.960096:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.960113:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.960125:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580319.960717:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d88ad96 reply state 000000002de82e65 transno 8589951125 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580319.960729:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580319.960882:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:283551:x1863919946822784:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1018us (6690us total) trans 8589951125 rc 0/0 00000100:00100000:3.0:1777580319.960891:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 822 00000100:00100000:0.0:1777580319.962528:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946823040 00000100:00100000:0.0:1777580319.962643:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946823040 00000100:00100000:0.0:1777580319.962718:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4279 00000100:00100000:0.0:1777580319.962730:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:283547:x1863919946823040:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580319.963516:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:283547:x1863919946823040:12345-192.168.202.9@tcp:35:touch.500 Request processed in 784us (9260us total) trans 8589951126 rc 0/0 00000100:00100000:0.0:1777580319.963526:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4279 00000100:00100000:2.0:1777580319.964994:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580319.967260:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:283544:x1863919946822528:12345-192.168.202.9@tcp:35:touch.500 Request processed in 17538us (24447us total) trans 8589951127 rc 0/0 00000100:00100000:0.0:1777580319.967277:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4278 00000100:00100000:1.0:1777580319.970627:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946823296 00000100:00100000:1.0:1777580319.970648:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946823296 00000100:00100000:1.0:1777580319.970725:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 823 00000100:00100000:2.0:1777580319.970727:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:283548:x1863919946822272:12345-192.168.202.9@tcp:36:touch.500 Request processed in 25742us (28681us total) trans 8589951124 rc 0/0 00000100:00100000:1.0:1777580319.970736:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+161:283553:x1863919946823296:12345-192.168.202.9@tcp:101:touch.500 00000100:00100000:2.0:1777580319.970746:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 821 00010000:00010000:1.0:1777580319.970773:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580319.970801:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4de1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0c4 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.970986:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.971004:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.971017:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.971047:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.971053:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.971059:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580319.971661:0:205909:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1606:0x0], index 0: 0 00010000:00010000:1.0:1777580319.977996:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4de2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978029:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4de2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978046:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4de2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978131:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978164:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978171:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978178:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580319.978183:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978211:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978226:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580319.978230:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580319.978236:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.978243:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b800/0xcb2b2f2f7e4de21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580319.978259:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000051817778 reply state 00000000c4e75918 transno 8589951128 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580319.978269:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580319.978334:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a200/0xcb2b2f2f7e4de1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0c4 expref: 163 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.985053:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4de2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0c4 expref: 162 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580319.985070:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa02427669a00) 00010000:00010000:1.0:1777580319.985074:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580319.985079:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:1.0:1777580319.985218:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283553:x1863919946823296:12345-192.168.202.9@tcp:101:touch.500 Request processed in 14482us (20231us total) trans 8589951128 rc 0/0 00000100:00100000:1.0:1777580319.985230:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 823 00010000:00010000:3.0:1777580319.998244:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998267:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998276:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998283:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580319.998289:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998298:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998323:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa02493ac1a00) 00010000:00010000:3.0:1777580319.998327:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580319.998346:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580319.998353:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de13 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007465:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007488:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007498:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007506:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.007512:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007520:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007551:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02427669900) 00010000:00010000:3.0:1777580320.007554:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.007561:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.007567:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b400/0xcb2b2f2f7e4de28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011222:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011245:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011253:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011259:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e86a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.011265:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011275:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011298:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa0241785f800) 00010000:00010000:2.0:1777580320.011301:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.011306:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.011334:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4de0c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.030657:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.036818:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946823808 00000100:00100000:3.0:1777580320.036838:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946823808 00000100:00100000:3.0:1777580320.036935:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 824 00000100:00100000:3.0:1777580320.036947:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+160:283554:x1863919946823808:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.036979:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.037028:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4de3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0cb expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037260:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037280:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037297:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037317:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037322:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.037461:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580320.038199:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e2:0x0], index 1: 0 00010000:00010000:3.0:1777580320.040842:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4de52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040872:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4de52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040890:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4de52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040947:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040977:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040983:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.040989:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.040993:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.041002:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.041016:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.041019:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.041024:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.041030:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4de44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.041049:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005bc1631e reply state 00000000cfc2abdb transno 8589951129 ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.041059:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580320.041111:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4de3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0cb expref: 163 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.041129:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4de52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0cb expref: 162 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.041171:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa02493ac1000) 00010000:00010000:3.0:1777580320.041174:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.041177:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20400, rc 0) 00000100:00100000:3.0:1777580320.041285:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283554:x1863919946823808:12345-192.168.202.9@tcp:101:touch.500 Request processed in 4340us (10642us total) trans 8589951129 rc 0/0 00000100:00100000:3.0:1777580320.041296:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 824 00000100:00100000:3.0:1777580320.041409:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.042701:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946823552 00000100:00100000:0.0:1777580320.042718:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946823552 00000100:00100000:0.0:1777580320.042800:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 825 00000100:00100000:0.0:1777580320.042812:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+163:283553:x1863919946823552:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:0.0:1777580320.042885:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580320.042913:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8b000/0xcb2b2f2f7e4de2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0c4 expref: 163 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.042935:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa02427669a00) 00010000:00010000:0.0:1777580320.042960:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580320.043046:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.043059:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.043071:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.043264:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ec8b27a7 reply state 00000000fd3d9a98 transno 8589951130 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.043275:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.043373:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:283553:x1863919946823552:12345-192.168.202.9@tcp:36:touch.500 Request processed in 563us (1963us total) trans 8589951130 rc 0/0 00000100:00100000:0.0:1777580320.043381:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 825 00000100:00100000:3.0:1777580320.044362:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.047194:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.047276:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946823936 00000100:00100000:3.0:1777580320.047298:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946823936 00000100:00100000:3.0:1777580320.047362:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824064 00000100:00100000:3.0:1777580320.047365:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824064 00000100:00100000:3.0:1777580320.047392:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 826 00000100:00100000:3.0:1777580320.047402:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+165:283548:x1863919946823936:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.047441:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.047475:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4de67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0d2 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.047711:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4de67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d2 expref: 166 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.047733:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4de67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d2 expref: 166 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.048106:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580320.048122:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.048128:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20600, rc 0) 00000100:00100000:3.0:1777580320.048233:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+166:283548:x1863919946823936:12345-192.168.202.9@tcp:101:touch.500 Request processed in 832us (3879us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.048242:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 826 00000100:00100000:3.0:1777580320.048276:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 827 00010000:00010000:2.0:1777580320.048755:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048798:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048806:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048812:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.048817:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048826:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048840:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02493ac1a00) 00010000:00010000:2.0:1777580320.048843:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.048847:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.048853:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4de4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.048962:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+164:283551:x1863919946824064:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.048984:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.049004:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4de6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0d9 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.049054:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4de6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d9 expref: 165 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.049069:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4de6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d9 expref: 165 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.049085:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa0241785f800) 00010000:00010000:3.0:1777580320.049088:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.049091:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b21e00, rc 0) 00000100:00100000:3.0:1777580320.049158:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+165:283551:x1863919946824064:12345-192.168.202.9@tcp:101:touch.500 Request processed in 850us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.049166:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 827 00000100:00100000:3.0:1777580320.049258:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.049413:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824576 00000100:00100000:3.0:1777580320.049421:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824576 00000100:00100000:3.0:1777580320.049462:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 828 00000100:00100000:3.0:1777580320.049491:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+165:283559:x1863919946824576:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.049502:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.049983:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4de75 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0e0 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050211:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050227:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050238:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050254:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050261:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.050268:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580320.051479:0:187631:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1607:0x0], index 0: 0 00000100:00100000:3.0:1777580320.055041:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580320.055188:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055202:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055227:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055234:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.055239:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055248:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055271:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa02488b77200) 00010000:00010000:3.0:1777580320.055274:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.055279:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.055285:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4de60 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056003:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4de8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056022:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4de8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056034:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4de8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056080:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056088:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056102:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056108:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.056111:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056117:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056127:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.056130:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.056162:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056169:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4de7c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.056182:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000083cb7c13 reply state 000000009685ef5e transno 8589951131 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.056192:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580320.056240:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4de75 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e0 expref: 167 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056256:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4de8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e0 expref: 166 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.056263:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580320.056272:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.056275:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fe00, rc 0) 00000100:00100000:3.0:1777580320.056363:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:283559:x1863919946824576:12345-192.168.202.9@tcp:101:touch.500 Request processed in 6875us (7104us total) trans 8589951131 rc 0/0 00000100:00100000:3.0:1777580320.056373:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 828 00000100:00100000:3.0:1777580320.056518:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824320 00000100:00100000:3.0:1777580320.056528:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824320 00000100:00100000:3.0:1777580320.058847:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 829 00000100:00100000:3.0:1777580320.058864:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+167:283554:x1863919946824320:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580320.064651:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580320.064704:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4de52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0cb expref: 167 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.064736:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa02493ac1000) 00010000:00010000:3.0:1777580320.064754:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.071794:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.071825:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.071841:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.072258:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000be9a8e8e reply state 00000000e2622a87 transno 8589951132 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.072271:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.072450:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+168:283554:x1863919946824320:12345-192.168.202.9@tcp:36:touch.500 Request processed in 13586us (17413us total) trans 8589951132 rc 0/0 00000100:00100000:3.0:1777580320.072475:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 829 00000100:00100000:3.0:1777580320.072933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.073122:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824832 00000100:00100000:3.0:1777580320.073265:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824832 00000100:00100000:3.0:1777580320.073340:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 830 00000100:00100000:3.0:1777580320.073352:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+168:283553:x1863919946824832:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.073383:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.073412:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4de9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0e7 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.073535:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4de9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e7 expref: 169 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.076508:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4de9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e7 expref: 169 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.076631:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa024185aa100) 00010000:00010000:3.0:1777580320.076635:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.076640:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f800, rc 0) 00000100:00100000:3.0:1777580320.076742:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+169:283553:x1863919946824832:12345-192.168.202.9@tcp:101:touch.500 Request processed in 3391us (3810us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.076754:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 830 00010000:00010000:2.0:1777580320.077120:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077165:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077172:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077179:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.077185:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077194:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077210:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa0249dea8500) 00010000:00010000:2.0:1777580320.077213:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.077217:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.077223:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4de83 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.080442:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.080478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.083369:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824704 00000100:00100000:3.0:1777580320.083392:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824704 00000100:00100000:3.0:1777580320.083505:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946824960 00000100:00100000:3.0:1777580320.083509:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946824960 00000100:00100000:3.0:1777580320.083686:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12205 00000100:00100000:3.0:1777580320.083701:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946824704:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580320.084247:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946824704:12345-192.168.202.9@tcp:2:touch.500 Request processed in 548us (3816us total) trans 8589939099 rc 0/0 00000100:00100000:3.0:1777580320.084256:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12205 00000100:00100000:3.0:1777580320.084285:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12206 00000100:00100000:3.0:1777580320.084292:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+34:2362:x1863919946824960:12345-192.168.202.9@tcp:2:touch.500 00000100:00080000:1.0:1777580320.084488:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777580320.084504:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777580320.086174:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946824960:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1870us (5683us total) trans 8589938699 rc 0/0 00000100:00100000:3.0:1777580320.086187:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12206 00000100:00100000:3.0:1777580320.089226:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.089264:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.089296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.089354:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.089395:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946825344 00000100:00100000:3.0:1777580320.089408:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946825344 00000100:00100000:3.0:1777580320.089464:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946825472 00000100:00100000:3.0:1777580320.089468:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946825472 00000100:00100000:3.0:1777580320.089485:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946825728 00000100:00100000:3.0:1777580320.089487:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946825728 00000100:00100000:3.0:1777580320.089509:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 831 00000100:00100000:3.0:1777580320.089519:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283559:x1863919946825344:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580320.089701:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580320.089741:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fe00/0xcb2b2f2f7e4de8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e0 expref: 170 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.089793:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580320.089807:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.089900:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.089917:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.089928:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.090101:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000735c4386 reply state 000000009e10b0da transno 8589951133 ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.090112:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.090251:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+171:283559:x1863919946825344:12345-192.168.202.9@tcp:36:touch.500 Request processed in 732us (985us total) trans 8589951133 rc 0/0 00000100:00100000:3.0:1777580320.090259:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 831 00000100:00100000:3.0:1777580320.090284:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 832 00000100:00100000:3.0:1777580320.090292:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283554:x1863919946825472:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.090305:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.090316:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4dead lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0ee expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.090354:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4dead lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x850:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0ee expref: 171 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.090383:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4dead lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x850:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0ee expref: 171 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.090402:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580320.090406:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.090409:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6f400, rc 0) 00000100:00100000:3.0:1777580320.090431:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+171:283554:x1863919946825472:12345-192.168.202.9@tcp:101:touch.500 Request processed in 141us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.090438:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 832 00000100:00100000:3.0:1777580320.090453:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 833 00000100:00100000:3.0:1777580320.090459:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+170:283561:x1863919946825728:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.090468:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.090484:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4deb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0f5 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093802:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093828:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093837:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093844:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6ec00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.093865:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093875:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093895:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa024185aa400) 00010000:00010000:2.0:1777580320.093899:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.093904:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.093912:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4de98 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094282:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094308:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094321:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094341:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094365:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.094373:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580320.095073:0:187632:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e3:0x0], index 1: 0 00010000:00010000:3.0:1777580320.095336:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4dec9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095350:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4dec9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095360:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4dec9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095408:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095416:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095422:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095428:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6fa00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.095433:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095440:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095466:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.095469:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.095473:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.095480:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6fa00/0xcb2b2f2f7e4debb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.095497:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007cd12104 reply state 000000008a9de57e transno 8589951134 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.095507:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.098422:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946825088 00000100:00100000:0.0:1777580320.098441:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946825088 00010000:00010000:3.0:1777580320.099766:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f200/0xcb2b2f2f7e4deb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0f5 expref: 172 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.099802:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4dec9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0f5 expref: 171 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.099813:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:3.0:1777580320.099816:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.099821:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54e4800, rc 0) 00000100:00100000:3.0:1777580320.099918:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+172:283561:x1863919946825728:12345-192.168.202.9@tcp:101:touch.500 Request processed in 9456us (10561us total) trans 8589951134 rc 0/0 00000100:00100000:3.0:1777580320.099929:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 833 00000100:00100000:3.0:1777580320.100217:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.100249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.100287:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.107390:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.107457:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946826496 00000100:00100000:3.0:1777580320.107470:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946826496 00000100:00100000:3.0:1777580320.107680:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 834 00000100:00100000:3.0:1777580320.107696:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+172:283559:x1863919946826496:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.107727:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.107753:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4ded7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f0fc expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.107844:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x851:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0fc expref: 173 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.107863:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4ded7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x851:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0fc expref: 173 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.107886:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580320.107889:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.107893:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02396b20800, rc 0) 00000100:00100000:3.0:1777580320.107960:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+173:283559:x1863919946826496:12345-192.168.202.9@tcp:101:touch.500 Request processed in 269us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.107968:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 834 00010000:00010000:3.0:1777580320.108196:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108206:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108212:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108231:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02388f6e000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.108236:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108244:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108256:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580320.108259:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.108263:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.108269:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6e000/0xcb2b2f2f7e4dea6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.108957:0:205896:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946826112 00000100:00100000:0.0:1777580320.108967:0:205896:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946826112 00000100:00100000:0.0:1777580320.109030:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12207 00000100:00100000:0.0:1777580320.109042:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2362:x1863919946825088:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580320.109632:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2362:x1863919946825088:12345-192.168.202.9@tcp:2:touch.500 Request processed in 501us (20327us total) trans 8589939100 rc 0/0 00000100:00100000:0.0:1777580320.109641:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12207 00000100:00100000:0.0:1777580320.109668:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12208 00000100:00100000:0.0:1777580320.109677:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+35:2361:x1863919946826112:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:0.0:1777580320.109864:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946826112:12345-192.168.202.9@tcp:2:touch.500 Request processed in 189us (9576us total) trans 8589938700 rc 0/0 00000100:00100000:0.0:1777580320.109883:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12208 00000100:00100000:0.0:1777580320.109917:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946825984 00000100:00100000:0.0:1777580320.109923:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946825984 00000100:00100000:0.0:1777580320.109952:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946826368 00000100:00100000:0.0:1777580320.109955:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946826368 00000100:00100000:0.0:1777580320.109968:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4280 00000100:00100000:0.0:1777580320.109974:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+173:283551:x1863919946825984:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580320.114010:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+174:283551:x1863919946825984:12345-192.168.202.9@tcp:35:touch.500 Request processed in 4018us (13776us total) trans 8589951135 rc 0/0 00000100:00100000:0.0:1777580320.114028:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4280 00000100:00100000:0.0:1777580320.114112:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4281 00000100:00100000:0.0:1777580320.114128:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+173:283548:x1863919946826368:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580320.114439:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+174:283548:x1863919946826368:12345-192.168.202.9@tcp:35:touch.500 Request processed in 317us (14189us total) trans 8589951136 rc 0/0 00000100:00100000:0.0:1777580320.114447:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4281 00000100:00100000:3.0:1777580320.114996:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.115079:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.115201:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.115272:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946826752 00000100:00100000:3.0:1777580320.115283:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946826752 00000100:00100000:3.0:1777580320.115328:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946827136 00000100:00100000:3.0:1777580320.115332:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946827136 00000100:00100000:3.0:1777580320.115354:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 835 00000100:00100000:3.0:1777580320.115363:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:283561:x1863919946826752:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580320.115417:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580320.115451:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4dec9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0f5 expref: 175 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.115476:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa024185aaf00) 00010000:00010000:3.0:1777580320.115504:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.115599:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.115615:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.115628:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.115774:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003dec7956 reply state 00000000bfc287e0 transno 8589951137 ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.115784:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.115877:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+176:283561:x1863919946826752:12345-192.168.202.9@tcp:36:touch.500 Request processed in 514us (883us total) trans 8589951137 rc 0/0 00000100:00100000:3.0:1777580320.115885:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 835 00000100:00100000:3.0:1777580320.115909:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 836 00000100:00100000:3.0:1777580320.115917:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+175:283564:x1863919946827136:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.115928:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.115940:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4dee5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f103 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116063:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116075:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116082:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116110:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116119:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116126:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580320.116718:0:187630:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1608:0x0], index 0: 0 00010000:00010000:3.0:1777580320.116932:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4defa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116945:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4defa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116955:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4defa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.116996:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117004:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117011:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117018:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784d600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.117024:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117046:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117060:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.117063:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.117067:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117074:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4deec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.117090:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000739c9014 reply state 000000006532f53f transno 8589951138 ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.117100:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580320.117176:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4dee5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f103 expref: 178 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117193:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4defa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f103 expref: 177 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.117200:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa024185aa000) 00010000:00010000:3.0:1777580320.117202:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.117205:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6600, rc 0) 00000100:00100000:3.0:1777580320.117274:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+178:283564:x1863919946827136:12345-192.168.202.9@tcp:101:touch.500 Request processed in 1357us (2071us total) trans 8589951138 rc 0/0 00000100:00100000:3.0:1777580320.117283:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 836 00000100:00100000:3.0:1777580320.117340:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946826880 00000100:00100000:3.0:1777580320.117357:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946826880 00000100:00100000:3.0:1777580320.117407:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12209 00000100:00100000:3.0:1777580320.117416:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2363:x1863919946826880:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:3.0:1777580320.117671:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2363:x1863919946826880:12345-192.168.202.9@tcp:2:touch.500 Request processed in 255us (2590us total) trans 8589939101 rc 0/0 00000100:00100000:3.0:1777580320.117680:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12209 00010000:00010000:2.0:1777580320.121470:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.121494:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.121503:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.121509:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.121515:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.121523:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.122487:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa024185aa600) 00010000:00010000:2.0:1777580320.122495:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.122523:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.122532:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4dec2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.126153:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.126195:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.127707:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946827392 00000100:00100000:0.0:1777580320.128016:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946827392 00000100:00100000:0.0:1777580320.130846:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946827648 00000100:00100000:0.0:1777580320.130868:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946827648 00000100:00100000:3.0:1777580320.133942:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.145281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.145313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.145413:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580320.145465:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145648:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145657:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145664:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.145670:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145679:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145700:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa024185aa500) 00010000:00010000:3.0:1777580320.145704:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.145839:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145847:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4dede lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145914:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145922:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145928:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145933:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02396b20400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.145936:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145941:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145950:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa024185aa300) 00010000:00010000:3.0:1777580320.145953:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.145955:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.145960:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4def3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.145993:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946828160 00000100:00100000:3.0:1777580320.146005:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946828160 00000100:00100000:3.0:1777580320.146055:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946828416 00000100:00100000:3.0:1777580320.146064:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946828416 00000100:00100000:3.0:1777580320.146083:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946828544 00000100:00100000:3.0:1777580320.146086:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946828544 00000100:00100000:3.0:1777580320.146107:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 837 00000100:00100000:3.0:1777580320.146119:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+179:283564:x1863919946828160:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580320.146634:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580320.146659:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4defa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f103 expref: 179 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.146674:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa024185aa000) 00010000:00010000:3.0:1777580320.146683:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.146898:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.146914:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.146926:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.147109:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000adc0d6fe reply state 0000000073b71e12 transno 8589951139 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.147119:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.147724:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+180:283564:x1863919946828160:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1602us (2454us total) trans 8589951139 rc 0/0 00000100:00100000:3.0:1777580320.147858:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 837 00000100:00100000:3.0:1777580320.147901:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 838 00000100:00100000:3.0:1777580320.147915:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+179:283562:x1863919946828416:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.147952:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.147970:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4df0f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f10a expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.148119:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.148261:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946827904 00000100:00100000:2.0:1777580320.148271:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946827904 00010000:00010000:3.0:1777580320.148460:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.148637:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.148663:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.148672:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.148680:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.150005:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 839 00000100:00100000:2.0:1777580320.150030:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283561:x1863919946828544:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580320.150059:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.150084:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4df24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f111 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.150179:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4df24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x852:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f111 expref: 182 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.150195:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4df24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x852:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f111 expref: 182 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.150217:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa02488b85300) 00010000:00010000:2.0:1777580320.150220:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580320.150223:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86200, rc 0) 00000100:00100000:2.0:1777580320.150299:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283561:x1863919946828544:12345-192.168.202.9@tcp:101:touch.500 Request processed in 282us (4886us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.150307:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 839 00000004:00080000:3.0:1777580320.155103:0:207396:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e4:0x0], index 1: 0 00000100:00100000:2.0:1777580320.155425:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4282 00000100:00100000:2.0:1777580320.155442:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283553:x1863919946827392:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580320.156355:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283553:x1863919946827392:12345-192.168.202.9@tcp:35:touch.500 Request processed in 913us (30232us total) trans 8589951140 rc 0/0 00000100:00100000:2.0:1777580320.156367:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4282 00000100:00100000:0.0:1777580320.156823:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4283 00000100:00100000:0.0:1777580320.156842:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283554:x1863919946827648:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:0.0:1777580320.157109:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283554:x1863919946827648:12345-192.168.202.9@tcp:35:touch.500 Request processed in 275us (30913us total) trans 8589951141 rc 0/0 00000100:00100000:0.0:1777580320.157118:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4283 00010000:00010000:3.0:1777580320.158064:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4df2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.158089:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4df2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.158103:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4df2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.158290:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4284 00000100:00100000:0.0:1777580320.158314:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283559:x1863919946827904:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580320.159035:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.159076:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.159815:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946828672 00000100:00100000:1.0:1777580320.159828:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946828672 00000100:00100000:1.0:1777580320.159899:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12210 00000100:00100000:1.0:1777580320.159910:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+36:2361:x1863919946828672:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:1.0:1777580320.160301:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2361:x1863919946828672:12345-192.168.202.9@tcp:2:touch.500 Request processed in 392us (1269us total) trans 8589938701 rc 0/0 00000100:00100000:1.0:1777580320.160309:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12210 00010000:00010000:3.0:1777580320.160926:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.160938:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.160947:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.160954:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.160960:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.160968:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.160987:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.160990:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.160996:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161004:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df16 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.161021:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b05dace3 reply state 000000007e9abed6 transno 8589951142 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.161032:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580320.161082:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4df0f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f10a expref: 184 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161155:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4df2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f10a expref: 183 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161163:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02497a21600) 00010000:00010000:3.0:1777580320.161166:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.161169:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6a00, rc 0) 00000100:00100000:3.0:1777580320.161219:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283562:x1863919946828416:12345-192.168.202.9@tcp:101:touch.500 Request processed in 13310us (15904us total) trans 8589951142 rc 0/0 00000100:00100000:3.0:1777580320.161227:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 838 00000100:00100000:3.0:1777580320.161251:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946828800 00000100:00100000:3.0:1777580320.161257:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946828800 00000100:00100000:3.0:1777580320.161299:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 840 00000100:00100000:3.0:1777580320.161308:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283564:x1863919946828800:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:3.0:1777580320.161326:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.161355:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4df39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f118 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161403:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4df39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x853:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f118 expref: 185 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161416:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4df39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x853:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f118 expref: 185 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161435:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580320.161438:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777580320.161447:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6000, rc 0) 00000100:00100000:3.0:1777580320.161466:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283564:x1863919946828800:12345-192.168.202.9@tcp:101:touch.500 Request processed in 160us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.161472:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 840 00010000:00010000:3.0:1777580320.161509:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161516:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161522:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161528:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.161530:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.161536:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.161690:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283559:x1863919946827904:12345-192.168.202.9@tcp:35:touch.500 Request processed in 3382us (27760us total) trans 8589951143 rc 0/0 00000100:00100000:0.0:1777580320.161701:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4284 00010000:00010000:3.0:1777580320.166206:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02499479700) 00010000:00010000:3.0:1777580320.166210:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.166219:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.166229:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.188417:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.188589:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829056 00000100:00100000:3.0:1777580320.188602:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829056 00000100:00100000:3.0:1777580320.188672:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4285 00000100:00100000:3.0:1777580320.188684:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+183:283561:x1863919946829056:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580320.189465:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283561:x1863919946829056:12345-192.168.202.9@tcp:35:touch.500 Request processed in 779us (1055us total) trans 8589951144 rc 0/0 00000100:00100000:2.0:1777580320.189483:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4285 00000100:00100000:3.0:1777580320.192832:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580320.192887:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192903:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192912:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192918:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.192923:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192931:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192951:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02497a21a00) 00010000:00010000:2.0:1777580320.192954:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.192959:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.192984:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7e00/0xcb2b2f2f7e4df1d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.198777:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829184 00000100:00100000:1.0:1777580320.198798:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829184 00000100:00100000:1.0:1777580320.198881:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12211 00000100:00100000:1.0:1777580320.198894:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2362:x1863919946829184:12345-192.168.202.9@tcp:2:touch.500 00000100:00100000:2.0:1777580320.200429:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.200665:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.200776:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2362:x1863919946829184:12345-192.168.202.9@tcp:2:touch.500 Request processed in 1883us (7958us total) trans 8589939102 rc 0/0 00000100:00100000:1.0:1777580320.200791:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12211 00000100:00100000:2.0:1777580320.209694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.210403:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829440 00000100:00100000:3.0:1777580320.210421:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829440 00000100:00100000:3.0:1777580320.210516:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829568 00000100:00100000:3.0:1777580320.210521:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829568 00000100:00100000:3.0:1777580320.210961:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 841 00000100:00100000:3.0:1777580320.210975:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283562:x1863919946829440:12345-192.168.202.9@tcp:36:touch.500 00010000:00010000:3.0:1777580320.211093:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580320.211168:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6a00/0xcb2b2f2f7e4df2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f10a expref: 184 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.211195:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02497a21600) 00010000:00010000:3.0:1777580320.211208:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.211300:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.211316:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.211328:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.211855:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000064ed71be reply state 00000000995fcf99 transno 8589951145 ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.211868:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.212014:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283562:x1863919946829440:12345-192.168.202.9@tcp:36:touch.500 Request processed in 1041us (11591us total) trans 8589951145 rc 0/0 00000100:00100000:3.0:1777580320.212024:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 841 00000100:00100000:3.0:1777580320.212072:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 842 00000100:00100000:3.0:1777580320.212082:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283565:x1863919946829568:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.212097:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.212111:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4df47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f11f expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212197:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212209:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212218:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212234:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212241:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212248:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212702:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212712:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212721:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580320.212871:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x848:0x0]: returning size 0 00000004:00200000:3.0:1777580320.212876:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580320.212899:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212913:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212921:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212927:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212934:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212941:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.212945:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212954:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212966:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.212969:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.212974:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.212981:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7200/0xcb2b2f2f7e4df4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213008:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213014:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213019:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213024:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de6600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.213027:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213032:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213039:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa02497a21b00) 00010000:00010000:3.0:1777580320.213041:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.213044:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213049:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6600/0xcb2b2f2f7e4df55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213085:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7000/0xcb2b2f2f7e4df47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f11f expref: 186 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.213100:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f11f expref: 185 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.214394:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829696 00000100:00100000:2.0:1777580320.214410:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829696 00000100:00100000:2.0:1777580320.214490:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 843 00000100:00100000:2.0:1777580320.214502:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283566:x1863919946829696:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580320.214524:0:187631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.214837:0:187631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4df63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f126 expref: -99 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214924:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214939:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214952:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214970:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214977:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.214983:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215518:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215529:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215637:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580320.215683:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x847:0x0]: returning size 0 00000004:00200000:2.0:1777580320.215688:0:187631:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580320.215714:0:187631:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215812:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215824:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215831:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215838:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215845:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e87a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.215849:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215857:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215881:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.215884:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.215890:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215897:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e87a00/0xcb2b2f2f7e4df6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215914:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215920:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215925:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215929:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4f800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.215932:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215937:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215943:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02488b85a00) 00010000:00010000:2.0:1777580320.215945:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.215947:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.215953:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4f800/0xcb2b2f2f7e4df71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.216004:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86a00/0xcb2b2f2f7e4df63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f126 expref: 188 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.216023:0:187631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f126 expref: 187 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.216030:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024ad9fd100) 00010000:00010000:2.0:1777580320.216033:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580320.216035:0:187631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d1400, rc 0) 00000100:00100000:2.0:1777580320.216911:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283566:x1863919946829696:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2404us (7225us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.216923:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 843 00000100:00100000:2.0:1777580320.217034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580320.217414:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580320.217423:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.217431:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02393de6c00, rc 0) 00000100:00100000:3.0:1777580320.217643:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283565:x1863919946829568:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5560us (16975us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.217652:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 842 00000100:00100000:3.0:1777580320.217688:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829824 00000100:00100000:3.0:1777580320.217697:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829824 00000100:00100000:3.0:1777580320.218230:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 844 00000100:00100000:3.0:1777580320.218242:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283576:x1863919946829824:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.218267:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.218296:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4df7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f12d expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218397:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218415:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218429:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218446:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218452:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218792:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218939:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218949:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.218956:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580320.218991:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x850:0x0]: returning size 0 00000004:00200000:3.0:1777580320.218995:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580320.219019:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219032:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219042:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219049:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219055:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219062:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54e4800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.219066:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219085:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219099:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.219102:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.219107:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.219114:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4800/0xcb2b2f2f7e4df86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.220492:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.220515:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.220522:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.220528:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784ca00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.220532:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222661:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222686:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa024185aa000) 00010000:00010000:3.0:1777580320.222690:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.222698:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222720:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ca00/0xcb2b2f2f7e4df8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222823:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20400/0xcb2b2f2f7e4df7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f12d expref: 188 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222843:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f12d expref: 187 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.222851:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580320.222854:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.222857:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0248784ce00, rc 0) 00000100:00100000:3.0:1777580320.222960:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283576:x1863919946829824:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4719us (5925us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.222972:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 844 00000100:00100000:0.0:1777580320.226647:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226842:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226862:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226881:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226909:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226944:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.226997:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.227041:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946829952 00000100:00100000:0.0:1777580320.227053:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946829952 00000100:00100000:0.0:1777580320.227108:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830080 00000100:00100000:0.0:1777580320.227111:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830080 00000100:00100000:0.0:1777580320.227163:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830208 00000100:00100000:0.0:1777580320.227166:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830208 00000100:00100000:0.0:1777580320.227179:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830336 00000100:00100000:0.0:1777580320.227182:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830336 00000100:00100000:0.0:1777580320.227191:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830464 00000100:00100000:0.0:1777580320.227194:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830464 00000100:00100000:0.0:1777580320.227208:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 845 00000100:00100000:0.0:1777580320.227220:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283577:x1863919946829952:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580320.227248:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580320.227276:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4df9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f134 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228033:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228074:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228088:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228108:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228115:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228127:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228309:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228318:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.228325:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580320.229003:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84f:0x0]: returning size 0 00000004:00200000:0.0:1777580320.229011:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580320.229039:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229056:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229084:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229090:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229098:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229104:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.229110:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229118:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229247:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.229250:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.229257:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229263:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4dfa2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229286:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229292:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229298:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229311:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.229314:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229320:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.229328:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02488b77200) 00010000:00010000:0.0:1777580320.229331:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.229333:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.229833:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 846 00000100:00100000:2.0:1777580320.229859:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283574:x1863919946830080:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580320.229886:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.229909:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4dfb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f13b expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.229986:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230000:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230012:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230045:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230052:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230059:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.230259:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4dfa9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.230315:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4df9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f134 expref: 194 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.230334:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f134 expref: 193 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230887:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230900:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230909:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580320.230945:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84d:0x0]: returning size 0 00000004:00200000:2.0:1777580320.230949:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580320.230973:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230986:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.230994:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231001:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231022:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231028:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fd000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.231032:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231039:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231051:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.231054:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.231059:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231066:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd000/0xcb2b2f2f7e4dfbe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231080:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231085:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231091:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231096:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023937fc600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.231099:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.231115:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.231267:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa024185aa100) 00010000:00010000:0.0:1777580320.231270:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580320.231273:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e4d400, rc 0) 00000100:00100000:0.0:1777580320.231388:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283577:x1863919946829952:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4168us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580320.231399:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 845 00000100:00100000:0.0:1777580320.231448:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 847 00000100:00100000:0.0:1777580320.231485:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283575:x1863919946830208:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:0.0:1777580320.231505:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580320.231517:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dfd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f142 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.232516:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 848 00000100:00100000:3.0:1777580320.232534:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283568:x1863919946830336:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.232858:0:188495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.232881:0:188495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4dfda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f149 expref: -99 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.232962:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.232980:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.233013:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.233031:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.233037:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.233044:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233267:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233278:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233285:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233299:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233305:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.233311:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.233459:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02488b85600) 00010000:00010000:2.0:1777580320.233464:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.233472:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.233491:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fc600/0xcb2b2f2f7e4dfc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.233882:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831232 00000100:00100000:1.0:1777580320.233895:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831232 00000100:00100000:1.0:1777580320.233967:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12212 00000100:00100000:1.0:1777580320.233977:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2364:x1863919946831232:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.233991:0:205905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.234012:0:205905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f16c expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580320.234095:0:205905:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1602:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:1.0:1777580320.234118:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580320.234254:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fce00/0xcb2b2f2f7e4dfb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f13b expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.234278:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f13b expref: 194 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.234286:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa0241785f300) 00010000:00010000:2.0:1777580320.234289:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580320.234292:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496e86600, rc 0) 00000100:00100000:0.0:1777580320.235083:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 849 00000100:00100000:0.0:1777580320.235102:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024a57e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283571:x1863919946830464:12345-192.168.202.9@tcp:101:rm.500 00000100:00100000:2.0:1777580320.235270:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283574:x1863919946830080:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5423us (8426us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.235277:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 846 00010000:00010000:1.0:1777580320.235722:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.235863:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 39 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.235891:0:205905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 39 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.235905:0:205905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b800, rc 0) 00000100:00100000:1.0:1777580320.235950:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2364:x1863919946831232:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1977us (8953us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.235957:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12212 00010000:00010000:0.0:1777580320.236248:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777580320.236278:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4e004 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f150 expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.236935:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.236969:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.236982:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.237005:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.237013:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.237019:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.237246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.237297:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830592 00000100:00100000:2.0:1777580320.237308:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830592 00010000:00010000:0.0:1777580320.238524:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.238678:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.238688:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.238698:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580320.238935:0:188495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84a:0x0]: returning size 0 00000004:00200000:3.0:1777580320.238942:0:188495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580320.238972:0:188495:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.238982:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 850 00010000:00010000:3.0:1777580320.238987:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.238997:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.239001:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283567:x1863919946830592:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.239018:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239025:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239032:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248784c000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.239037:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239045:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239051:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.239058:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.239061:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.239066:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e027 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f157 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239068:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239075:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784c000/0xcb2b2f2f7e4dfe1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239092:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239098:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239104:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239109:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.239118:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239125:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239150:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa024185aa300) 00010000:00010000:3.0:1777580320.239153:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.239156:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239162:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4dfe8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239205:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784d600/0xcb2b2f2f7e4dfda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f149 expref: 197 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239222:0:188495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f149 expref: 196 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.239230:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479900) 00010000:00010000:3.0:1777580320.239231:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.239234:0:188495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6ec00, rc 0) 00000100:00100000:3.0:1777580320.239317:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283568:x1863919946830336:12345-192.168.202.9@tcp:101:rm.500 Request processed in 6788us (12433us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.239324:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 848 00010000:00010000:0.0:1777580320.239444:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239455:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239468:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580320.239481:0:205914:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84b:0x0]: returning size 0 00000004:00200000:0.0:1777580320.239484:0:205914:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1777580320.239491:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.239495:0:205914:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239499:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239502:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239519:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239523:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239526:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239529:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239533:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239546:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239550:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.239628:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239636:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239640:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239644:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239647:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239655:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.239658:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.239661:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580320.239662:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x849:0x0]: returning size 0 00010000:00010000:0.0:1777580320.239667:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8e00/0xcb2b2f2f7e4e00b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580320.239670:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580320.239684:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239684:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239691:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239694:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239698:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239701:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239708:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239709:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.239712:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239715:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239718:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239720:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680ee00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.239723:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239729:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239737:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.239739:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.239742:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239747:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680ee00/0xcb2b2f2f7e4e02e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239768:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239785:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239790:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239794:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023f8ee8000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.239797:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239802:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239810:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02488b85b00) 00010000:00010000:2.0:1777580320.239812:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.239815:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239821:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee8000/0xcb2b2f2f7e4e035 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239847:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e027 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f157 expref: 197 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239859:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f157 expref: 196 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.239865:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02499479000) 00010000:00010000:2.0:1777580320.239867:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580320.239877:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee9200, rc 0) 00000100:00100000:2.0:1777580320.239908:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283567:x1863919946830592:12345-192.168.202.9@tcp:101:rm.500 Request processed in 917us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.239915:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 850 00010000:00010000:0.0:1777580320.239917:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02487fb4f00) 00010000:00010000:0.0:1777580320.239920:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.239924:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239930:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e012 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239956:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9200/0xcb2b2f2f7e4e004 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f150 expref: 196 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239968:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f150 expref: 195 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.239975:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02493ac1500) 00010000:00010000:0.0:1777580320.239977:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580320.239979:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc400, rc 0) 00000100:00100000:0.0:1777580320.240001:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024a57e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283571:x1863919946830464:12345-192.168.202.9@tcp:101:rm.500 Request processed in 4908us (13091us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580320.240007:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 849 00000100:00100000:0.0:1777580320.240051:0:187633:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830976 00000100:00100000:2.0:1777580320.240057:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.240067:0:187633:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830976 00000100:00100000:2.0:1777580320.240108:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831360 00000100:00100000:0.0:1777580320.240110:0:187633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4286 00000100:00100000:2.0:1777580320.240112:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831360 00000100:00100000:0.0:1777580320.240119:0:187633:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c4b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283564:x1863919946830976:12345-192.168.202.9@tcp:35:touch.500 00000100:00100000:2.0:1777580320.240168:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12213 00000100:00100000:2.0:1777580320.240175:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+37:2364:x1863919946831360:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580320.240186:0:207637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.240203:0:207637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f173 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777580320.240232:0:207637:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15de:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:2.0:1777580320.240247:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580320.240250:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580320.240258:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 38 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240274:0:207637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 38 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240285:0:207637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023f8ee8600, rc 0) 00000100:00100000:2.0:1777580320.240303:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238639d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+38:2364:x1863919946831360:12345-192.168.202.9@tcp:101:rm.500 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.240308:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12213 00000100:00100000:2.0:1777580320.240383:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.240407:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946830720 00000100:00100000:2.0:1777580320.240411:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946830720 00000100:00100000:2.0:1777580320.240433:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 851 00000100:00100000:2.0:1777580320.240440:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+197:283572:x1863919946830720:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:2.0:1777580320.240448:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.240457:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4e04a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f15e expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240492:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240493:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240502:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240502:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240510:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240515:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240520:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02393de7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.240521:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240523:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240528:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240530:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240534:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240552:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02497a21d00) 00010000:00010000:2.0:1777580320.240610:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240619:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240636:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240639:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.240643:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.240648:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de7c00/0xcb2b2f2f7e4df40 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580320.240658:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84c:0x0]: returning size 0 00000004:00200000:2.0:1777580320.240660:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777580320.240674:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240682:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240689:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240695:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.240696:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580320.240700:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240705:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.240708:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240714:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240722:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.240724:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.240727:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240743:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032400/0xcb2b2f2f7e4e051 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.240754:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.240911:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.241120:0:187633:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c4b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283564:x1863919946830976:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1001us (14174us total) trans 8589951146 rc 0/0 00000100:00100000:0.0:1777580320.241128:0:187633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4286 00010000:00010000:0.0:1777580320.242320:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242353:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242367:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777580320.242410:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x84e:0x0]: returning size 0 00000004:00200000:0.0:1777580320.242414:0:187630:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777580320.242435:0:187630:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242448:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242458:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242465:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242471:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242489:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.242494:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242501:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242515:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.242518:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.242523:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242530:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4dfef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.242547:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243446:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243454:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243459:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023a95d8200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.243463:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243471:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243500:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02488b77500) 00010000:00010000:0.0:1777580320.243502:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.243506:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.243513:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8200/0xcb2b2f2f7e4dff6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.244793:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4dfd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f142 expref: 196 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.244834:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f142 expref: 195 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.244843:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa0241785f800) 00010000:00010000:0.0:1777580320.244846:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777580320.244849:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024975bc800, rc 0) 00000100:00100000:0.0:1777580320.244943:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283575:x1863919946830208:12345-192.168.202.9@tcp:101:rm.500 Request processed in 13474us (18078us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580320.244954:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 847 00010000:00010000:2.0:1777580320.245780:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245789:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245795:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.245800:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245809:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245822:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02493ac1000) 00010000:00010000:2.0:1777580320.245825:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.245829:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245836:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248c032800/0xcb2b2f2f7e4e058 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245886:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9400/0xcb2b2f2f7e4e04a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f15e expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245914:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f15e expref: 194 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.245922:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:2.0:1777580320.245924:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777580320.245927:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484838400, rc 0) 00000100:00100000:2.0:1777580320.245985:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283572:x1863919946830720:12345-192.168.202.9@tcp:101:rm.500 Request processed in 5545us (5600us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.245993:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 851 00000100:00100000:2.0:1777580320.246025:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831104 00000100:00100000:2.0:1777580320.246034:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831104 00000100:00100000:2.0:1777580320.246080:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 852 00000100:00100000:2.0:1777580320.247308:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283562:x1863919946831104:12345-192.168.202.9@tcp:101:touch.500 00010000:00010000:2.0:1777580320.247335:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777580320.247366:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e06d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f165 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.247440:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e06d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x854:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f165 expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.247457:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e06d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x854:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f165 expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.248630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.248664:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.248690:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831488 00000100:00100000:3.0:1777580320.248701:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831488 00000100:00100000:3.0:1777580320.248791:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831744 00000100:00100000:3.0:1777580320.248795:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831744 00000100:00100000:3.0:1777580320.248813:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831872 00000100:00100000:3.0:1777580320.248816:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831872 00000100:00100000:3.0:1777580320.248837:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12214 00000100:00100000:3.0:1777580320.248848:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2362:x1863919946831488:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.248879:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.248942:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f17a expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.248974:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15e2:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.248995:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.248998:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.249009:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249027:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249043:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6e000, rc 0) 00000100:00100000:3.0:1777580320.249111:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2362:x1863919946831488:12345-192.168.202.9@tcp:101:rm.500 Request processed in 264us (8414us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.249119:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12214 00000100:00100000:3.0:1777580320.249172:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12215 00000100:00100000:3.0:1777580320.249180:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2362:x1863919946831744:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.249189:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.249203:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f188 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.249222:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1604:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.249231:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.249244:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.249250:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249263:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249273:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fa00, rc 0) 00000100:00100000:3.0:1777580320.249295:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2362:x1863919946831744:12345-192.168.202.9@tcp:101:rm.500 Request processed in 117us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.249301:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12215 00000100:00100000:3.0:1777580320.249315:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12216 00000100:00100000:3.0:1777580320.249322:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+39:2364:x1863919946831872:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.249330:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.249355:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f18f expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.249370:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15df:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.249379:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.249381:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.249385:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249396:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 40 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.249418:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02388f6fe00, rc 0) 00000100:00100000:3.0:1777580320.249437:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+40:2364:x1863919946831872:12345-192.168.202.9@tcp:101:rm.500 Request processed in 116us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.249442:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12216 00000100:00100000:3.0:1777580320.249500:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.249576:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:2.0:1777580320.249597:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02493ac1a00) 00010000:00010000:2.0:1777580320.249602:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777580320.249614:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02484839800, rc 0) 00000100:00100000:2.0:1777580320.249640:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283562:x1863919946831104:12345-192.168.202.9@tcp:101:touch.500 Request processed in 2355us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580320.249648:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 852 00000100:00100000:1.0:1777580320.251391:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832000 00000100:00100000:1.0:1777580320.251405:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832000 00000100:00100000:1.0:1777580320.252255:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946831616 00000100:00100000:1.0:1777580320.252266:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946831616 00000100:00100000:1.0:1777580320.252329:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12217 00000100:00100000:1.0:1777580320.252340:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2362:x1863919946832000:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.252367:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.252395:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f196 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580320.252430:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1603:0x0] initial LVB size: 0, mtime: 0x69f3b91e, atime: 0x69f3b91e, ctime: 0x69f3b91e, blocks: 0x1 00010000:00010000:1.0:1777580320.252456:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.252458:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.252472:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 42 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.252509:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 42 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.252540:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b000, rc 0) 00000100:00100000:1.0:1777580320.252622:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2362:x1863919946832000:12345-192.168.202.9@tcp:101:rm.500 Request processed in 284us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.252630:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12217 00000100:00100000:1.0:1777580320.252654:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12218 00000100:00100000:1.0:1777580320.252661:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+41:2361:x1863919946831616:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.252668:0:206023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.252679:0:206023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f181 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580320.252692:0:206023:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1606:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:1.0:1777580320.252701:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.252702:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.252707:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 42 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.252718:0:206023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 42 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.252726:0:206023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8a200, rc 0) 00000100:00100000:1.0:1777580320.252747:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946831616:12345-192.168.202.9@tcp:101:rm.500 Request processed in 87us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.252753:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12218 00000100:00100000:1.0:1777580320.261638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.261684:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.262234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.262262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.262316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.262354:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832128 00000100:00100000:1.0:1777580320.262367:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832128 00000100:00100000:1.0:1777580320.262423:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832384 00000100:00100000:1.0:1777580320.262426:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832384 00000100:00100000:1.0:1777580320.262444:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832256 00000100:00100000:1.0:1777580320.262446:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832256 00000100:00100000:1.0:1777580320.262465:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832768 00000100:00100000:1.0:1777580320.262467:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832768 00000100:00100000:1.0:1777580320.262737:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12219 00000100:00100000:1.0:1777580320.262749:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946832128:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.262781:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.262809:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f19d expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777580320.262843:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15e1:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:1.0:1777580320.262867:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.262870:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.262881:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 43 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.262901:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 43 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.262917:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8b400, rc 0) 00000100:00100000:3.0:1777580320.262945:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12220 00000100:00100000:3.0:1777580320.262955:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946832384:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.262964:0:206352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.262976:0:206352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1ab expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.262992:0:206352:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15e0:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00000100:00100000:1.0:1777580320.262993:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946832128:12345-192.168.202.9@tcp:101:rm.500 Request processed in 248us (1370us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580320.263001:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580320.263001:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12219 00010000:00010000:3.0:1777580320.263003:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.263007:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 44 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.263018:0:206352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 43 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.263022:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12221 00010000:00010000:3.0:1777580320.263028:0:206352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb4a00, rc 0) 00000100:00100000:1.0:1777580320.263029:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2364:x1863919946832256:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.263036:0:205898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.263049:0:205898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1a4 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.263051:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946832384:12345-192.168.202.9@tcp:101:rm.500 Request processed in 99us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.263066:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12220 00002000:00010000:1.0:1777580320.263067:0:205898:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1605:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:1.0:1777580320.263075:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580320.263077:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1777580320.263079:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12222 00010000:00010000:1.0:1777580320.263081:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 43 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.263085:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+42:2361:x1863919946832768:12345-192.168.202.9@tcp:2:touch.500 00010000:00010000:1.0:1777580320.263093:0:205898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 43 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.263101:0:205898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02496d8aa00, rc 0) 00000100:00100000:1.0:1777580320.263120:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2364:x1863919946832256:12345-192.168.202.9@tcp:101:rm.500 Request processed in 92us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.263368:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12221 00000100:00100000:3.0:1777580320.268854:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+43:2361:x1863919946832768:12345-192.168.202.9@tcp:2:touch.500 Request processed in 5752us (6521us total) trans 8589938702 rc 0/0 00000100:00100000:3.0:1777580320.268874:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12222 00000100:00100000:3.0:1777580320.268943:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946832640 00000100:00100000:3.0:1777580320.268955:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946832640 00000100:00100000:3.0:1777580320.269016:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 853 00000100:00100000:3.0:1777580320.269026:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283546:x1863919946832640:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.269110:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.269168:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4400/0xcb2b2f2f7e4dcf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x842:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f054 expref: 195 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269194:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fde00/0xcb2b2f2f7e4db26 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x842:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efd6 expref: 194 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269207:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa024993dfe00) 00010000:00010000:3.0:1777580320.269224:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.269255:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269273:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269285:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269321:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269329:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269338:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269499:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269508:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.269515:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.280451:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1914, 64 off130688 00000004:00080000:3.0:1777580320.280491:0:188495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7841229355430ns, next at 7842229344172ns, rc = 0 00000100:00100000:1.0:1777580320.281797:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.282053:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946833024 00000100:00100000:0.0:1777580320.282068:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946833024 00010000:00010000:3.0:1777580320.282226:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282254:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282270:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282280:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282300:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282306:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282328:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580320.282489:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4287 00000100:00100000:0.0:1777580320.282501:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283562:x1863919946833024:12345-192.168.202.9@tcp:35:touch.500 00010000:00010000:3.0:1777580320.282920:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282930:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282935:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282941:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.282945:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282953:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282966:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa02491fc3500) 00010000:00010000:3.0:1777580320.282969:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.282975:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.282981:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x842:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283016:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283022:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283027:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283030:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.283033:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283038:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283044:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.283046:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.283049:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.283053:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.283063:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4b87a66 reply state 00000000c2dfd764 transno 8589951147 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.283070:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.284501:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+197:283562:x1863919946833024:12345-192.168.202.9@tcp:35:touch.500 Request processed in 1989us (2702us total) trans 8589951148 rc 0/0 00000100:00100000:0.0:1777580320.284544:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4287 00000100:00100000:3.0:1777580320.284834:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+196:283546:x1863919946832640:12345-192.168.202.9@tcp:36:rm.500 Request processed in 15807us (22568us total) trans 8589951147 rc 0/0 00000100:00100000:3.0:1777580320.284843:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 853 00010000:00010000:3.0:1777580320.284886:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.284895:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.284905:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.284910:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.284921:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.284938:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x842:0x0].0x0 (ffffa02491fc3500) 00010000:00010000:3.0:1777580320.284941:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.284945:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.284950:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x842:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.284972:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.284973:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.284975:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.290970:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.290993:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.291002:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.291009:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.291035:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.291044:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.291064:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x74204fa8 (ffffa024185aa000) 00010000:00010000:3.0:1777580320.291068:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.291074:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.291080:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.294578:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.294886:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946833280 00000100:00100000:0.0:1777580320.294901:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946833280 00000100:00100000:0.0:1777580320.294985:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 854 00000100:00100000:0.0:1777580320.294996:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283557:x1863919946833280:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580320.295076:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580320.295113:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4dca0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x844:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f046 expref: 195 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295159:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4ea00/0xcb2b2f2f7e4db88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x844:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eff2 expref: 194 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295171:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa024c6346000) 00010000:00010000:0.0:1777580320.295184:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580320.295217:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295234:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295245:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295262:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295269:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.295286:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298002:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298029:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298045:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580320.298773:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1915, 64 off130752 00010000:00010000:0.0:1777580320.298851:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298866:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298877:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298886:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298892:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298898:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298929:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580320.298967:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298974:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298980:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.298987:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.298992:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299000:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299015:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa02488b77500) 00010000:00010000:0.0:1777580320.299018:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580320.299023:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299030:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e0d6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x844:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299054:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299061:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299067:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299081:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.299084:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299090:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299097:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.299099:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.299102:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.299107:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e0c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.299118:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000da2f52e6 reply state 00000000fd3d9a98 transno 8589951149 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.299127:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.299278:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+195:283557:x1863919946833280:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4278us (4707us total) trans 8589951149 rc 0/0 00000100:00100000:0.0:1777580320.299289:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 854 00010000:00010000:3.0:1777580320.307161:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307182:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307190:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307197:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.307203:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307213:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307233:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffffa02487fb4f00) 00010000:00010000:3.0:1777580320.307236:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.307253:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.307261:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e0cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308632:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.308647:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308672:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.308676:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308685:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308701:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x844:0x0].0x0 (ffffa02488b77500) 00010000:00010000:1.0:1777580320.308704:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.308708:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308714:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e0dd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x844:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.308740:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.308743:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.308744:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580320.316094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.316198:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946833536 00000100:00100000:3.0:1777580320.316211:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946833536 00000100:00100000:3.0:1777580320.316279:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 855 00000100:00100000:3.0:1777580320.316307:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283542:x1863919946833536:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.316391:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.316424:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8400/0xcb2b2f2f7e4dd2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x841:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f062 expref: 194 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.316457:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680e600/0xcb2b2f2f7e4daf5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x841:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efc8 expref: 193 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.316469:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa024ad9fd400) 00010000:00010000:3.0:1777580320.316481:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.316511:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.316528:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.316538:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.317470:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.317509:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.317519:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.319074:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.319092:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.319104:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.323314:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1918, 64 off130944 00000004:00080000:3.0:1777580320.323331:0:207396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7841272195492ns, next at 7842272191978ns, rc = 0 00010000:00010000:3.0:1777580320.323978:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324000:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324014:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324023:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324030:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324051:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324083:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.324113:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324119:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324125:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324131:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.324164:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324173:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324187:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580320.324190:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.324195:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324202:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5a00/0xcb2b2f2f7e4e0f2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x841:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324227:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324243:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324248:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324254:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.324257:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324263:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.324271:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.324273:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.324277:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.327240:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5400/0xcb2b2f2f7e4e0e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.327911:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000014a982e2 reply state 00000000a521fccf transno 8589951150 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.327929:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.328092:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283542:x1863919946833536:12345-192.168.202.9@tcp:36:rm.500 Request processed in 11782us (12006us total) trans 8589951150 rc 0/0 00000100:00100000:3.0:1777580320.328104:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 855 00010000:00010000:3.0:1777580320.328189:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.328197:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.328226:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb4c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.328231:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.328239:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.328258:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x841:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580320.328260:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.328266:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.328272:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb4c00/0xcb2b2f2f7e4e0f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x841:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.328313:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.328315:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.328316:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.334451:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334481:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334490:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334497:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb5000 already unused, calling callback (ffffffffc1fac4f0) 00000100:00100000:3.0:1777580320.334498:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580320.334502:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334523:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334542:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xb5064fa8 (ffffa02491fc3500) 00010000:00010000:1.0:1777580320.334545:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777580320.334546:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946833792 00010000:00010000:1.0:1777580320.334552:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.334560:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb5000/0xcb2b2f2f7e4e0eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.334893:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946833792 00000100:00100000:3.0:1777580320.334974:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 856 00000100:00100000:3.0:1777580320.334986:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283563:x1863919946833792:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.335070:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.335097:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4dcd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x846:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f04d expref: 193 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335118:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4dbea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x846:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f00e expref: 192 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335168:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa02481358500) 00010000:00010000:3.0:1777580320.335179:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.335208:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335225:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335237:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335253:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335259:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335266:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335421:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335429:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.335436:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.341011:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1916, 64 off130816 00010000:00010000:3.0:1777580320.341124:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341200:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341215:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341226:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341233:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341241:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341279:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.341322:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341327:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341333:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341338:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.341343:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341351:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341376:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa02491fc3900) 00010000:00010000:3.0:1777580320.341379:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.341384:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341389:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50600/0xcb2b2f2f7e4e10e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x846:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341415:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341421:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341426:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341430:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.341431:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.341433:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341437:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341439:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341445:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.341447:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.341449:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341450:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.341453:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341455:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.341459:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51200/0xcb2b2f2f7e4e100 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341464:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x846:0x0].0x0 (ffffa02491fc3900) 00010000:00010000:1.0:1777580320.341466:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.341468:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.341482:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002f73eca7 reply state 00000000472102c1 transno 8589951151 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.341484:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50a00/0xcb2b2f2f7e4e115 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x846:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.341492:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777580320.341502:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.341509:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.341511:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580320.341624:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283563:x1863919946833792:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6635us (7126us total) trans 8589951151 rc 0/0 00000100:00100000:3.0:1777580320.341635:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 856 00010000:00010000:3.0:1777580320.357626:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357647:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357655:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357661:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.357667:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357675:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357695:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x3bf54fa8 (ffffa02491fc3600) 00010000:00010000:3.0:1777580320.357698:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.357703:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.357710:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e107 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.359048:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.359108:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834048 00000100:00100000:3.0:1777580320.359123:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834048 00000100:00100000:3.0:1777580320.359209:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 857 00000100:00100000:3.0:1777580320.359221:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283552:x1863919946834048:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.359684:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.359719:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fda00/0xcb2b2f2f7e4dcbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x843:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f03f expref: 192 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360070:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fcc00/0xcb2b2f2f7e4db57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x843:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efe4 expref: 191 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360082:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa024993df900) 00010000:00010000:3.0:1777580320.360098:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.360129:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360171:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360181:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360202:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.360209:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.363259:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.363769:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.363787:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.363796:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.367021:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1919, 64 off131008 00010000:00010000:3.0:1777580320.367132:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367171:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367185:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367193:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367199:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367205:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367228:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.367275:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367282:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.367500:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580320.367509:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.367550:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.367943:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580320.367949:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.367973:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.367987:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa02491fc3100) 00010000:00010000:0.0:1777580320.367990:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580320.367996:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.368002:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e131 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x843:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.368021:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.368022:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.368108:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.368114:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368121:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368130:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x843:0x0].0x0 (ffffa02491fc3100) 00010000:00010000:3.0:1777580320.368132:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.368162:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368168:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e12a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x843:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368201:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368208:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368213:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368230:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.368233:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368239:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368247:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.368249:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.368252:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.368257:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51800/0xcb2b2f2f7e4e11c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.368270:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001dc2f82c reply state 000000000f0e55be transno 8589951152 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.368282:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.368843:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283552:x1863919946834048:12345-192.168.202.9@tcp:36:rm.500 Request processed in 9616us (9797us total) trans 8589951152 rc 0/0 00000100:00100000:3.0:1777580320.368854:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 857 00010000:00010000:0.0:1777580320.374002:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580320.374781:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.374821:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834304 00000100:00100000:0.0:1777580320.374835:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834304 00000100:00100000:0.0:1777580320.374899:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 858 00000100:00100000:0.0:1777580320.374911:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283560:x1863919946834304:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580320.374993:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580320.375028:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4dd1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x845:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f05b expref: 192 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375050:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d9a00/0xcb2b2f2f7e4dbb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x845:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f000 expref: 191 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375065:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa024c6346a00) 00010000:00010000:0.0:1777580320.375076:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580320.375113:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375131:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375169:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375186:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375194:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.375201:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375493:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375503:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375510:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375528:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.375533:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375637:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375648:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc8244fa8 (ffffa02491fc3800) 00010000:00010000:3.0:1777580320.375652:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.375656:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.375662:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e123 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.376528:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.376641:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.376653:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580320.377966:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1920, 64 off131072 00010000:00010000:0.0:1777580320.378058:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378076:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378105:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378114:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378120:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378126:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378189:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580320.378219:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378227:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378233:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378239:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.378244:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378251:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378264:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa02488b77500) 00010000:00010000:0.0:1777580320.378268:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580320.378280:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378528:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.378634:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378642:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.378646:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378653:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378663:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x845:0x0].0x0 (ffffa02488b77500) 00010000:00010000:3.0:1777580320.378666:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.378669:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378689:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e14d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x845:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.378707:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.378709:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.378711:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.378748:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e146 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x845:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378785:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378792:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378797:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378802:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4c800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.378805:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378810:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378818:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.378821:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.378824:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.378829:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4c800/0xcb2b2f2f7e4e138 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.378840:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000056ff3548 reply state 000000009d164dca transno 8589951153 ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.378861:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.379024:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283560:x1863919946834304:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4108us (4244us total) trans 8589951153 rc 0/0 00000100:00100000:0.0:1777580320.379035:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 858 00010000:00010000:0.0:1777580320.379194:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580320.385635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.385742:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.385792:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834432 00000100:00100000:3.0:1777580320.385804:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834432 00010000:00010000:0.0:1777580320.388864:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388886:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388894:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388900:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496e4da00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.388906:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388914:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388935:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x814b4fa8 (ffffa02488b77200) 00010000:00010000:0.0:1777580320.388939:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.388944:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.388950:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4da00/0xcb2b2f2f7e4e13f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.390059:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834560 00000100:00100000:3.0:1777580320.390078:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834560 00000100:00100000:3.0:1777580320.390170:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 859 00000100:00100000:3.0:1777580320.390183:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283578:x1863919946834432:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.390217:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.390245:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e154 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1b2 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.390978:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391000:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391014:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391032:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391064:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391072:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391262:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391272:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.391280:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580320.392022:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x851:0x0]: returning size 0 00000004:00200000:3.0:1777580320.392028:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580320.392055:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392070:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392080:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392088:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392095:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392118:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.392123:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392132:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392180:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.392183:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.392190:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392196:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e15b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392216:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392223:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392229:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392234:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.392237:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392242:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392263:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02491fc3600) 00010000:00010000:3.0:1777580320.392266:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.392269:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392276:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e162 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392458:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e154 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b2 expref: 193 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392476:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b2 expref: 192 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392485:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580320.392488:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.392491:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa023deff1200, rc 0) 00000100:00100000:3.0:1777580320.392691:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283578:x1863919946834432:12345-192.168.202.9@tcp:101:rm.500 Request processed in 2510us (7074us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.392701:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 859 00000100:00100000:3.0:1777580320.392853:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 860 00000100:00100000:3.0:1777580320.392868:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283581:x1863919946834560:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.392888:0:187632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.392903:0:187632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e170 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1b9 expref: -99 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.392959:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393027:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393037:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393053:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393060:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393066:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393221:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393229:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393236:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580320.393261:0:187632:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x854:0x0]: returning size 0 00000004:00200000:3.0:1777580320.393264:0:187632:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580320.393281:0:187632:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393527:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393642:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393649:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393655:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393660:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.393664:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393670:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393681:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.393683:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.393687:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393692:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e177 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393705:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393711:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393716:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393834:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.393837:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393844:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393852:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580320.393854:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.393857:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393863:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e17e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393899:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e170 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b9 expref: 193 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393912:0:187632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b9 expref: 192 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.393919:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02493ac1a00) 00010000:00010000:3.0:1777580320.393921:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777580320.393924:0:187632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51000, rc 0) 00000100:00100000:3.0:1777580320.393981:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283581:x1863919946834560:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1118us (8239us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.393990:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 860 00000100:00100000:3.0:1777580320.394093:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.394234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.394253:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834688 00000100:00100000:1.0:1777580320.394264:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834688 00000100:00100000:1.0:1777580320.394306:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834816 00000100:00100000:1.0:1777580320.394309:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834816 00000100:00100000:1.0:1777580320.394330:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 861 00000100:00100000:1.0:1777580320.394340:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283579:x1863919946834688:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.394358:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.394374:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4e18c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1c0 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394432:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394444:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394454:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394481:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394488:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394495:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394605:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394627:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394634:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580320.394661:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x852:0x0]: returning size 0 00000004:00200000:1.0:1777580320.394665:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580320.394683:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394692:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394700:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394706:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394713:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394718:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.394722:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394728:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394737:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.394746:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.394751:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394777:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8a400/0xcb2b2f2f7e4e193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394790:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394797:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394803:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394809:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.394811:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394817:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394825:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02417834e00) 00010000:00010000:1.0:1777580320.394827:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.394830:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394836:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e19a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394865:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496d8ae00/0xcb2b2f2f7e4e18c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c0 expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394885:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c0 expref: 194 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.394892:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa02488b85300) 00010000:00010000:1.0:1777580320.394894:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580320.394897:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024a5fb7000, rc 0) 00000100:00100000:1.0:1777580320.394938:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283579:x1863919946834688:12345-192.168.202.9@tcp:101:rm.500 Request processed in 600us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.394947:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 861 00000100:00100000:1.0:1777580320.394971:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 862 00000100:00100000:1.0:1777580320.394979:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283580:x1863919946834816:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:1.0:1777580320.394987:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580320.394996:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e1a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1c7 expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395026:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395034:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395042:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395055:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395073:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395080:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395170:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395179:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395187:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580320.395206:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x853:0x0]: returning size 0 00000004:00200000:1.0:1777580320.395209:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580320.395219:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395227:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395235:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395241:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395246:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395262:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.395266:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395271:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395280:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.395282:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.395285:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395291:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e1af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395302:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395308:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395313:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395319:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.395321:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395327:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395345:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02498977000) 00010000:00010000:1.0:1777580320.395347:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.395350:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395356:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e1b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395381:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e1a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c7 expref: 195 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395393:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c7 expref: 194 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.395400:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02499479700) 00010000:00010000:1.0:1777580320.395403:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777580320.395405:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6200, rc 0) 00000100:00100000:1.0:1777580320.395431:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283580:x1863919946834816:12345-192.168.202.9@tcp:101:rm.500 Request processed in 452us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580320.395438:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 862 00000100:00100000:3.0:1777580320.403816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.418786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.418818:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.418839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.418889:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.418931:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946834944 00000100:00100000:3.0:1777580320.418943:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946834944 00000100:00100000:3.0:1777580320.419001:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946835072 00000100:00100000:3.0:1777580320.419005:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946835072 00000100:00100000:3.0:1777580320.419020:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946835200 00000100:00100000:3.0:1777580320.419023:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946835200 00000100:00100000:3.0:1777580320.419039:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946835328 00000100:00100000:3.0:1777580320.419041:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946835328 00000100:00100000:3.0:1777580320.419062:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12223 00000100:00100000:3.0:1777580320.419074:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2361:x1863919946834944:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.419104:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.419168:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1ce expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.419212:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1607:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.419238:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419241:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419253:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419274:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419314:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50600, rc 0) 00000100:00100000:3.0:1777580320.419393:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2361:x1863919946834944:12345-192.168.202.9@tcp:101:rm.500 Request processed in 320us (15590us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.419402:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12223 00000100:00100000:3.0:1777580320.419429:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12224 00000100:00100000:3.0:1777580320.419436:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2363:x1863919946835072:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.419445:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.419459:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1d5 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.419478:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15e3:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.419489:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419490:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419495:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419507:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419516:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51200, rc 0) 00000100:00100000:3.0:1777580320.419538:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2363:x1863919946835072:12345-192.168.202.9@tcp:101:rm.500 Request processed in 103us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.419545:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12224 00000100:00100000:3.0:1777580320.419558:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12225 00000100:00100000:3.0:1777580320.419572:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2363:x1863919946835200:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.419580:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.419592:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1dc expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.419606:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1608:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.419616:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419618:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.419622:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419633:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.419641:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f50a00, rc 0) 00000100:00100000:3.0:1777580320.419660:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2363:x1863919946835200:12345-192.168.202.9@tcp:101:rm.500 Request processed in 90us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.419666:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12225 00000100:00100000:3.0:1777580320.419678:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12226 00000100:00100000:3.0:1777580320.419684:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+44:2362:x1863919946835328:12345-192.168.202.9@tcp:101:rm.500 00010000:00010000:3.0:1777580320.419691:0:205907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580320.421041:0:205907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1e3 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777580320.421081:0:205907:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15e4:0x0] initial LVB size: 0, mtime: 0x69f3b91f, atime: 0x69f3b91f, ctime: 0x69f3b91f, blocks: 0x1 00010000:00010000:3.0:1777580320.421109:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.421129:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580320.421156:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421179:0:205907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 45 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421196:0:205907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02383f51800, rc 0) 00000100:00100000:3.0:1777580320.421264:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:1220a945-26e8-4f93-ba75-88d1936cf5a4+45:2362:x1863919946835328:12345-192.168.202.9@tcp:101:rm.500 Request processed in 1577us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580320.421273:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12226 00000100:00100000:3.0:1777580320.421352:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946835584 00000100:00100000:3.0:1777580320.421361:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946835584 00000100:00100000:3.0:1777580320.421415:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 863 00000100:00100000:3.0:1777580320.421424:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283565:x1863919946835584:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.421488:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.421518:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6c00/0xcb2b2f2f7e4df5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x848:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f11f expref: 194 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421540:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d200/0xcb2b2f2f7e4dc4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x848:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f02a expref: 193 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421552:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa02499479b00) 00010000:00010000:3.0:1777580320.421561:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.421589:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421604:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421623:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421639:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421646:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.421653:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.431881:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.431906:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.431921:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.435272:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1917, 64 off130880 00010000:00010000:3.0:1777580320.440041:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440071:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440086:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440096:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440121:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440127:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440169:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.440205:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440211:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440217:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440222:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.440226:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440235:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440248:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580320.440251:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.440256:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440262:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e1ee lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x848:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440318:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440325:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.440330:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.442717:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.443449:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.443467:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.443491:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.443494:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.443498:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.443506:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e1e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.443530:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b335c77f reply state 0000000027ea3401 transno 8589951154 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.443640:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.444112:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+194:283565:x1863919946835584:12345-192.168.202.9@tcp:36:rm.500 Request processed in 22680us (25214us total) trans 8589951154 rc 0/0 00000100:00100000:3.0:1777580320.444123:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 863 00010000:00010000:1.0:1777580320.444698:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.444710:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.444720:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.444840:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.444865:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.444883:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x848:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:1.0:1777580320.444886:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.444890:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.444897:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0e00/0xcb2b2f2f7e4e1f5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x848:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.444923:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.444925:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.444926:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.451029:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451049:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451058:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451065:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.451072:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451081:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451101:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffffa024993dfe00) 00010000:00010000:3.0:1777580320.451104:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.451110:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.451116:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e1e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.473892:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.474855:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946835840 00000100:00100000:2.0:1777580320.474875:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946835840 00000100:00100000:2.0:1777580320.475163:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 864 00000100:00100000:2.0:1777580320.475177:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283566:x1863919946835840:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580320.475259:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580320.475295:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4df78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x847:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f126 expref: 193 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475844:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023937fd600/0xcb2b2f2f7e4dc1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x847:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f01c expref: 192 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475861:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa024ad9fd100) 00010000:00010000:2.0:1777580320.475874:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580320.475910:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475928:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475940:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475969:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.475977:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.476002:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.476679:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.476689:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.476697:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580320.477680:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1921, 64 off131136 00010000:00010000:2.0:1777580320.477775:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477788:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477799:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477807:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477814:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477822:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477855:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580320.477891:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477897:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477903:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477909:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.477912:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477920:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477933:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa02488b85b00) 00010000:00010000:2.0:1777580320.477936:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580320.477941:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.477947:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e20a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x847:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478261:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478267:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478273:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478290:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.478294:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478300:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478309:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.478311:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.478314:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.478320:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e1fc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580320.478331:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007a7285df reply state 000000009660cc77 transno 8589951155 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.478341:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777580320.478415:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580320.478430:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.478435:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580320.478438:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.478444:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.478453:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x847:0x0].0x0 (ffffa02488b85b00) 00010000:00010000:0.0:1777580320.478455:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1777580320.478456:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+193:283566:x1863919946835840:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3277us (4573us total) trans 8589951155 rc 0/0 00010000:00010000:0.0:1777580320.478458:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.478463:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e211 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x847:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.478466:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 864 00010000:00010000:0.0:1777580320.478479:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.478480:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.478482:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.491242:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491266:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491275:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491298:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.491304:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491324:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491347:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xee224fa8 (ffffa02493ac1000) 00010000:00010000:2.0:1777580320.491351:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.491357:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.491364:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e203 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.500591:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580320.501171:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946836096 00000100:00100000:0.0:1777580320.501186:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946836096 00000100:00100000:0.0:1777580320.501260:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 865 00000100:00100000:0.0:1777580320.501273:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283571:x1863919946836096:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:0.0:1777580320.501366:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777580320.501404:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e019 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f150 expref: 192 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501435:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0c00/0xcb2b2f2f7e4dde2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0b6 expref: 191 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501466:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02493ac1500) 00010000:00010000:0.0:1777580320.501479:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580320.501509:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501526:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501549:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501568:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501575:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501582:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501730:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501738:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.501745:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580320.502482:0:187631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1922, 64 off131200 00010000:00010000:0.0:1777580320.502562:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502583:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502592:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502599:0:187631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502606:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502613:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502646:0:187631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580320.502671:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502677:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502684:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502691:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.502696:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502705:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502725:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02488b77500) 00010000:00010000:0.0:1777580320.502729:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580320.502733:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502739:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bce00/0xcb2b2f2f7e4e226 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502743:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580320.502750:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502765:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580320.502768:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502774:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502774:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502781:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502784:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84b:0x0].0x0 (ffffa02488b77500) 00010000:00010000:2.0:1777580320.502786:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580320.502787:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502789:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502792:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.502795:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502801:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502803:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc000/0xcb2b2f2f7e4e22d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.502809:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.502810:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.502813:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502818:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.502818:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e218 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.502820:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.502821:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1777580320.502838:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000050529c45 reply state 00000000eb76105a transno 8589951156 ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.502859:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.502977:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+192:283571:x1863919946836096:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1704us (2397us total) trans 8589951156 rc 0/0 00000100:00100000:0.0:1777580320.502987:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 865 00010000:00010000:3.0:1777580320.509455:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509478:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509486:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509511:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.509517:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509526:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509556:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffffa02488b77200) 00010000:00010000:3.0:1777580320.509560:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.509565:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.509571:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bd800/0xcb2b2f2f7e4e21f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.510220:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.512808:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946836352 00000100:00100000:3.0:1777580320.512839:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946836352 00000100:00100000:3.0:1777580320.512931:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 866 00000100:00100000:3.0:1777580320.512943:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283576:x1863919946836352:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.513023:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.513057:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0248784ce00/0xcb2b2f2f7e4df94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x850:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f12d expref: 191 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513085:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f400/0xcb2b2f2f7e4dead lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x850:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0ee expref: 190 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513098:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa024185aa400) 00010000:00010000:3.0:1777580320.513109:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.513174:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513193:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513205:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513222:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513229:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513236:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513417:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513425:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.513433:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.515363:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1918, 64 off130944 00010000:00010000:3.0:1777580320.515467:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515489:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515519:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515528:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515549:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515556:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515588:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.515619:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515625:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515631:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515637:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.515642:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515650:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515665:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:3.0:1777580320.515669:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.515682:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515689:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e242 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x850:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515716:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515723:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515729:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515734:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.515737:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515742:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515750:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.515752:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.515768:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.515774:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e234 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.515785:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d19a507 reply state 00000000cb5f4467 transno 8589951157 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.515806:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.515934:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+191:283576:x1863919946836352:12345-192.168.202.9@tcp:36:rm.500 Request processed in 2988us (5715us total) trans 8589951157 rc 0/0 00000100:00100000:3.0:1777580320.515945:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 866 00010000:00010000:3.0:1777580320.516010:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.516017:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.516023:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.516027:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.516033:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.516043:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x850:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:3.0:1777580320.516045:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.516047:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.516053:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e249 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x850:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.516066:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.516068:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.516070:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.529584:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529606:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529637:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529644:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.529650:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529659:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529683:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffffa02491fc3800) 00010000:00010000:3.0:1777580320.529686:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.529692:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.529699:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e23b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.530883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.531079:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946836608 00000100:00100000:3.0:1777580320.531091:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946836608 00000100:00100000:3.0:1777580320.531186:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 867 00000100:00100000:3.0:1777580320.531199:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+190:283568:x1863919946836608:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.531634:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.531668:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6ec00/0xcb2b2f2f7e4e020 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f149 expref: 190 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.531690:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023a95d8800/0xcb2b2f2f7e4dd33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f070 expref: 189 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.531720:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02499479900) 00010000:00010000:3.0:1777580320.532506:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.532832:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.532854:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.532867:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.532887:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.532894:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.532900:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.533058:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.533067:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.533074:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.536610:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1919, 64 off131008 00010000:00010000:3.0:1777580320.536740:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536790:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536805:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536815:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536822:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536829:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536851:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.536882:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536888:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536894:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536900:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.536904:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536911:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536953:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:3.0:1777580320.536956:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.536962:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536968:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e25e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.536995:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537001:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537005:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537010:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.537013:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537018:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537025:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.537027:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.537030:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.537036:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e250 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.537057:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bde609c7 reply state 00000000fbcc781f transno 8589951158 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.537067:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.537229:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+190:283568:x1863919946836608:12345-192.168.202.9@tcp:36:rm.500 Request processed in 6026us (6349us total) trans 8589951158 rc 0/0 00000100:00100000:3.0:1777580320.537242:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 867 00010000:00010000:1.0:1777580320.537850:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.537860:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.537868:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.537873:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.537880:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.537893:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84a:0x0].0x0 (ffffa02491fc3a00) 00010000:00010000:1.0:1777580320.537896:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.537911:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.537918:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0200/0xcb2b2f2f7e4e265 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.537936:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.537938:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.537939:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580320.553125:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580320.553192:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946836864 00000100:00100000:2.0:1777580320.553206:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946836864 00000100:00100000:2.0:1777580320.553286:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 868 00000100:00100000:2.0:1777580320.553299:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+190:283577:x1863919946836864:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580320.553379:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580320.553416:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e4d400/0xcb2b2f2f7e4dfb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f134 expref: 190 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.553446:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02388f6f800/0xcb2b2f2f7e4de9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0e7 expref: 189 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.553458:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa024185aa100) 00010000:00010000:2.0:1777580320.553973:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580320.554010:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554028:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554041:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554057:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554083:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554094:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554101:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554108:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.554113:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554122:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554184:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554194:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554445:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554455:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.554462:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554639:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x82ce4fa8 (ffffa02491fc3600) 00010000:00010000:1.0:1777580320.554644:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.554649:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.554657:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e257 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580320.559242:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1923, 64 off131264 00010000:00010000:2.0:1777580320.559731:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559764:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559779:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559788:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559795:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559801:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559833:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580320.559864:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559871:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559878:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559884:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.559890:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559899:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559914:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:2.0:1777580320.559918:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580320.559924:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559931:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e27a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559954:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559961:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559977:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559982:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.559985:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.559992:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.560000:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.560003:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.560006:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.560012:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839000/0xcb2b2f2f7e4e26c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580320.560023:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000eb979c9a reply state 00000000e3bd3861 transno 8589951159 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.560034:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580320.560794:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+189:283577:x1863919946836864:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7486us (7670us total) trans 8589951159 rc 0/0 00000100:00100000:2.0:1777580320.560808:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 868 00010000:00010000:0.0:1777580320.562400:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580320.562413:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.562427:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580320.562432:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.562442:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.562461:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84f:0x0].0x0 (ffffa02488b85a00) 00010000:00010000:0.0:1777580320.562465:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580320.562469:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.562476:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839400/0xcb2b2f2f7e4e281 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.562503:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.562505:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.562506:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.573121:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.573190:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.573199:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.573206:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.573211:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.573215:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:0.0:1777580320.573220:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.573240:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffffa02488b85600) 00010000:00010000:0.0:1777580320.573243:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.573250:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.573257:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839a00/0xcb2b2f2f7e4e273 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.574062:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946837120 00000100:00100000:1.0:1777580320.574077:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946837120 00000100:00100000:1.0:1777580320.574166:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 869 00000100:00100000:1.0:1777580320.574178:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:283567:x1863919946837120:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580320.574255:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580320.574280:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023f8ee9200/0xcb2b2f2f7e4e03c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x849:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f157 expref: 188 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574312:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f50e00/0xcb2b2f2f7e4dc7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x849:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f038 expref: 187 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574323:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02499479000) 00010000:00010000:1.0:1777580320.574446:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580320.574479:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574496:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574508:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574524:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574531:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574624:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574887:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574896:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.574903:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580320.576212:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1924, 64 off131328 00010000:00010000:1.0:1777580320.576988:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577008:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577020:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577030:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577037:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577044:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577071:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580320.577096:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577119:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577126:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577158:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.577163:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577172:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577186:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02498977f00) 00010000:00010000:1.0:1777580320.577189:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580320.577194:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577201:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6000/0xcb2b2f2f7e4e296 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x849:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577223:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577230:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577237:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577241:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.577250:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577257:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577265:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.577267:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.577269:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577275:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e288 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580320.577523:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000add50936 reply state 00000000c6826cd5 transno 8589951160 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.577630:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580320.577906:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+188:283567:x1863919946837120:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3724us (4690us total) trans 8589951160 rc 0/0 00000100:00100000:1.0:1777580320.577918:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 869 00010000:00010000:1.0:1777580320.577965:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.577971:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577978:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.577982:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.577989:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.578018:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x849:0x0].0x0 (ffffa02498977f00) 00010000:00010000:1.0:1777580320.578021:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.578024:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.578031:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e29d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x849:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.578047:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.578049:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.578051:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.585586:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585607:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585616:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585622:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.585654:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585663:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585683:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffffa02498977000) 00010000:00010000:0.0:1777580320.585687:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.585693:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.585700:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e28f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.589040:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.589475:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946837376 00000100:00100000:1.0:1777580320.589489:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946837376 00000100:00100000:1.0:1777580320.589648:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 870 00000100:00100000:1.0:1777580320.589661:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283575:x1863919946837376:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580320.589840:0:188495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580320.589875:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc800/0xcb2b2f2f7e4e066 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f142 expref: 187 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.589903:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b21e00/0xcb2b2f2f7e4de6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d9 expref: 186 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.589916:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa0241785f800) 00010000:00010000:1.0:1777580320.589930:0:188495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580320.589963:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.589981:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590014:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590035:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590042:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590049:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590628:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590641:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.590649:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580320.591898:0:188495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1920, 64 off131072 00010000:00010000:1.0:1777580320.591994:0:188495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592011:0:188495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592022:0:188495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592031:0:188495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592049:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592056:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592075:0:188495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580320.592107:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592113:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592120:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592127:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.592169:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592178:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592190:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa02498977900) 00010000:00010000:1.0:1777580320.592193:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580320.592198:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592204:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2b2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592237:0:188495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592243:0:188495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592248:0:188495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592252:0:188495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.592255:0:188495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592260:0:188495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592267:0:188495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.592269:0:188495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.592272:0:188495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.592277:0:188495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580320.592285:0:188495:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f0499b7e reply state 00000000629b3bc3 transno 8589951161 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.592294:0:188495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777580320.592952:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.592963:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.592972:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.592976:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.592982:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.592994:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84e:0x0].0x0 (ffffa02498977900) 00010000:00010000:3.0:1777580320.592997:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.593000:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.593007:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.593027:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.593040:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.593042:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580320.594080:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+187:283575:x1863919946837376:12345-192.168.202.9@tcp:36:rm.500 Request processed in 4412us (5043us total) trans 8589951161 rc 0/0 00000100:00100000:0.0:1777580320.594094:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 870 00010000:00010000:0.0:1777580320.597085:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597106:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597115:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597122:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.597129:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597179:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597223:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffffa02498977600) 00010000:00010000:0.0:1777580320.597226:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.597233:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.597240:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7a00/0xcb2b2f2f7e4e2ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.606023:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.606125:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946837632 00000100:00100000:1.0:1777580320.606189:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946837632 00000100:00100000:1.0:1777580320.606266:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 871 00000100:00100000:1.0:1777580320.606306:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283572:x1863919946837632:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580320.606401:0:205909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580320.606435:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e05f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f15e expref: 186 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606459:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4dddb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0af expref: 185 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606470:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa024993dfa00) 00010000:00010000:1.0:1777580320.606482:0:205909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580320.606514:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606672:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606688:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606708:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606715:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606722:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606890:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606912:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.606919:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777580320.611671:0:205909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1921, 64 off131136 00010000:00010000:1.0:1777580320.611948:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.611971:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.611986:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.611996:0:205909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612002:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612009:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612045:0:205909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580320.612073:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612080:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612108:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612114:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.612118:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612127:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612164:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa02498977100) 00010000:00010000:2.0:1777580320.612167:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.612168:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580320.612174:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612174:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612182:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7400/0xcb2b2f2f7e4e2ce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.612192:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580320.612195:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.612200:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612207:0:205909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.612208:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84c:0x0].0x0 (ffffa02498977100) 00010000:00010000:2.0:1777580320.612211:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777580320.612213:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612214:0:205909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.612220:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6400/0xcb2b2f2f7e4e2d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612221:0:205909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612225:0:205909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.612227:0:205909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.612236:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.612238:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.612239:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.612241:0:205909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612249:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580320.612251:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.612254:0:205909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.612259:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7c00/0xcb2b2f2f7e4e2c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580320.612271:0:205909:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d230860c reply state 000000004320c3e4 transno 8589951162 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580320.612281:0:205909:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580320.613869:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+186:283572:x1863919946837632:12345-192.168.202.9@tcp:36:rm.500 Request processed in 7558us (7850us total) trans 8589951162 rc 0/0 00000100:00100000:1.0:1777580320.613883:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 871 00010000:00010000:1.0:1777580320.619718:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619763:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619773:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619780:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a5fb7800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.619786:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619823:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619847:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffffa02498977f00) 00010000:00010000:1.0:1777580320.619850:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.619857:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.619864:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7800/0xcb2b2f2f7e4e2c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.621701:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.622689:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946837888 00000100:00100000:3.0:1777580320.622705:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946837888 00000100:00100000:3.0:1777580320.622787:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 872 00000100:00100000:3.0:1777580320.622799:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283574:x1863919946837888:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.622874:0:205914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.622910:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86600/0xcb2b2f2f7e4dfcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f13b expref: 185 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.622935:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20600/0xcb2b2f2f7e4de67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x84d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0d2 expref: 184 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.622949:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa0241785f300) 00010000:00010000:3.0:1777580320.622961:0:205914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.622991:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623007:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623018:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623033:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623040:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623071:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623286:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623295:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.623301:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.625968:0:205914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1925, 64 off131392 00010000:00010000:3.0:1777580320.626065:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626087:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626100:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626110:0:205914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626117:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626124:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626269:0:205914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.626329:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626343:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626350:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626355:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.626359:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626367:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626381:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:3.0:1777580320.626383:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.626389:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626395:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e2ea lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x84d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626420:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626426:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626431:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626447:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.626451:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626456:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626464:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.626466:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.626469:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.626475:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e2dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.626486:0:205914:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008253bdc6 reply state 0000000013017eba transno 8589951163 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.626497:0:205914:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.626640:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+185:283574:x1863919946837888:12345-192.168.202.9@tcp:36:rm.500 Request processed in 3836us (4948us total) trans 8589951163 rc 0/0 00000100:00100000:3.0:1777580320.626650:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 872 00010000:00010000:2.0:1777580320.629024:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629045:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629053:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629059:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.629063:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629089:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629109:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x68dcc0a8 (ffffa02491fc3800) 00010000:00010000:2.0:1777580320.629112:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.629118:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.629125:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e2e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634064:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580320.634094:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634109:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.634114:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634126:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634166:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x84d:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:1.0:1777580320.634170:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.634175:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634181:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e2f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x84d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.634208:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.634233:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580320.634235:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580320.642046:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580320.642308:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946838144 00000100:00100000:1.0:1777580320.642322:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946838144 00000100:00100000:1.0:1777580320.642392:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 873 00000100:00100000:1.0:1777580320.642404:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283578:x1863919946838144:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:1.0:1777580320.642488:0:191688:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777580320.642528:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e169 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x851:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b2 expref: 184 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642573:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02396b20800/0xcb2b2f2f7e4ded7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x851:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f0fc expref: 183 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642589:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa024185aac00) 00010000:00010000:1.0:1777580320.642601:0:191688:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580320.642633:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642652:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642664:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642680:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642687:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642693:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642882:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642891:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.642899:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580320.644347:0:191688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1926, 64 off131456 00010000:00010000:0.0:1777580320.644453:0:191688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644715:0:191688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644731:0:191688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644740:0:191688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644747:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644762:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644789:0:191688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580320.644821:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644827:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644846:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644852:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.644857:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580320.644857:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.644864:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.644866:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.644871:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.650668:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.650695:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.650721:0:187618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa02498977100) 00010000:00010000:1.0:1777580320.650914:0:187618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.650924:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.650932:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bde00/0xcb2b2f2f7e4e30d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x851:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.651091:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.651096:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580320.651099:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.659952:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x851:0x0].0x0 (ffffa02498977100) 00010000:00010000:0.0:1777580320.659964:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580320.659981:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.659993:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6800/0xcb2b2f2f7e4e306 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x851:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660048:0:191688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660057:0:191688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660064:0:191688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660069:0:191688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.660073:0:191688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660149:0:191688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660170:0:191688:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.660173:0:191688:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.660176:0:191688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.660182:0:191688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7600/0xcb2b2f2f7e4e2f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.660195:0:191688:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000056870c91 reply state 00000000a6d42113 transno 8589951164 ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.660207:0:191688:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.660949:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1220a945-26e8-4f93-ba75-88d1936cf5a4+184:283578:x1863919946838144:12345-192.168.202.9@tcp:36:rm.500 Request processed in 18538us (18909us total) trans 8589951164 rc 0/0 00000100:00100000:0.0:1777580320.660962:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 873 00010000:00010000:1.0:1777580320.689876:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689919:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689928:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689933:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580320.689940:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689949:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689971:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffffa02498977f00) 00010000:00010000:1.0:1777580320.689974:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580320.689981:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.689987:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e2ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 191688 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.690167:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.694126:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946838400 00000100:00100000:3.0:1777580320.694175:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946838400 00000100:00100000:3.0:1777580320.694270:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 874 00000100:00100000:3.0:1777580320.694292:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+183:283581:x1863919946838400:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.694379:0:207396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.694439:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e185 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x854:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1b9 expref: 183 pid: 187632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694467:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e06d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x854:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f165 expref: 182 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694480:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02493ac1a00) 00010000:00010000:3.0:1777580320.694492:0:207396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.694523:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694540:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694552:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694568:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694575:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694582:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694746:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694766:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.694787:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777580320.695507:0:207396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1922, 64 off131200 00010000:00010000:3.0:1777580320.695585:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695599:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695609:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695617:0:207396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695624:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695630:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695658:0:207396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777580320.695684:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695690:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695697:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695716:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.695721:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695729:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695734:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.695740:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:0.0:1777580320.695741:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695743:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777580320.695748:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695748:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580320.695751:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695765:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1c00/0xcb2b2f2f7e4e322 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x854:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695766:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695786:0:207396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695787:0:187619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x854:0x0].0x0 (ffffa02491fc3600) 00010000:00010000:0.0:1777580320.695789:0:187619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777580320.695792:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695793:0:207396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695799:0:207396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695799:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1200/0xcb2b2f2f7e4e329 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x854:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695804:0:207396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580320.695806:0:207396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695811:0:207396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.695814:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.695815:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580320.695817:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.695826:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:3.0:1777580320.695829:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580320.695832:0:207396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.695838:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff0400/0xcb2b2f2f7e4e314 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777580320.695848:0:207396:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000064c9be10 reply state 00000000ac885531 transno 8589951165 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580320.695857:0:207396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777580320.695992:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+183:283581:x1863919946838400:12345-192.168.202.9@tcp:36:rm.500 Request processed in 1709us (6690us total) trans 8589951165 rc 0/0 00000100:00100000:3.0:1777580320.696002:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 874 00010000:00010000:0.0:1777580320.703173:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703195:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703203:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703210:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.703216:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703224:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703244:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffffa02491fc3a00) 00010000:00010000:0.0:1777580320.703248:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.703253:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.703283:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1000/0xcb2b2f2f7e4e31b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.712893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580320.713861:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946838656 00000100:00100000:3.0:1777580320.713877:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946838656 00000100:00100000:3.0:1777580320.714511:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 875 00000100:00100000:3.0:1777580320.714527:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283579:x1863919946838656:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:3.0:1777580320.714622:0:187632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777580320.714659:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a5fb7000/0xcb2b2f2f7e4e1a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x852:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c0 expref: 182 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.714685:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02496e86200/0xcb2b2f2f7e4df24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x852:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f111 expref: 181 pid: 188495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.714700:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa02488b85300) 00010000:00010000:3.0:1777580320.714929:0:187632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580320.714964:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.714982:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.714993:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715009:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715016:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715023:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715197:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715205:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.715212:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777580320.737084:0:187632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1923, 64 off131264 00010000:00010000:0.0:1777580320.737519:0:187632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.738324:0:187632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.738425:0:187632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.738436:0:187632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.738443:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.738450:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739318:0:187632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580320.739371:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739380:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739386:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739413:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.739417:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739425:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739441:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa024185aac00) 00010000:00010000:0.0:1777580320.739444:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777580320.739448:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739455:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1e00/0xcb2b2f2f7e4e33e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x852:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739486:0:187632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739492:0:187632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739496:0:187632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739501:0:187632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.739503:0:187632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739508:0:187632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739526:0:187632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:0.0:1777580320.739528:0:187632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.739706:0:187632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.739715:0:187632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1400/0xcb2b2f2f7e4e330 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777580320.739817:0:187632:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c706ffbd reply state 000000003fe71784 transno 8589951166 ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580320.739828:0:187632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777580320.740669:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283579:x1863919946838656:12345-192.168.202.9@tcp:36:rm.500 Request processed in 26139us (27782us total) trans 8589951166 rc 0/0 00000100:00100000:0.0:1777580320.740682:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 875 00010000:00010000:2.0:1777580320.751231:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751253:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751262:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751269:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.751275:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751284:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751305:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffffa02491fc3800) 00010000:00010000:2.0:1777580320.751341:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.751348:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.751355:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa023deff1a00/0xcb2b2f2f7e4e337 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.807293:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777580320.809433:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580320.824887:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.824911:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580320.824918:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.824930:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.825004:0:208519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x852:0x0].0x0 (ffffa024185aac00) 00010000:00010000:1.0:1777580320.825008:0:208519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777580320.825015:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580320.825022:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024975bc400/0xcb2b2f2f7e4e345 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x852:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.837583:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946838912 00000100:00100000:2.0:1777580320.837603:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946838912 00000100:00100000:2.0:1777580320.843623:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 876 00000100:00100000:2.0:1777580320.843650:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283580:x1863919946838912:12345-192.168.202.9@tcp:36:rm.500 00010000:00010000:2.0:1777580320.844491:0:187630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777580320.844536:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e1bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x853:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1c7 expref: 181 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844564:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02393de6000/0xcb2b2f2f7e4df39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x853:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f118 expref: 180 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844578:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02499479700) 00010000:00010000:2.0:1777580320.844591:0:187630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580320.844621:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844638:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844649:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844666:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844691:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844699:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844973:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844982:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.844989:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777580320.853475:0:187630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1927, 64 off131520 00010000:00010000:2.0:1777580320.860623:0:187630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.860656:0:187630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.860672:0:187630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.860683:0:187630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.860690:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.860696:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861470:0:187630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580320.861508:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861517:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861523:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861530:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838a00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.861536:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861545:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861560:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02488b85600) 00010000:00010000:2.0:1777580320.861563:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777580320.861569:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861574:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838a00/0xcb2b2f2f7e4e35a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x853:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861599:0:187630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861605:0:187630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861626:0:187630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861632:0:187630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839c00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580320.861635:0:187630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861641:0:187630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861649:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:2.0:1777580320.861652:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580320.861654:0:187630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580320.861660:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839c00/0xcb2b2f2f7e4e34c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580320.861671:0:187630:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000006082baf reply state 0000000035fc4faf transno 8589951167 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580320.861681:0:187630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580320.863539:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283580:x1863919946838912:12345-192.168.202.9@tcp:36:rm.500 Request processed in 19888us (109772us total) trans 8589951167 rc 0/0 00000100:00100000:2.0:1777580320.863552:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 876 00010000:00010000:0.0:1777580320.872902:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.872924:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.872933:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.872939:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839800 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580320.872946:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.872954:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.872992:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffffa02488b85300) 00010000:00010000:0.0:1777580320.872996:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580320.873002:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580320.873010:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484839800/0xcb2b2f2f7e4e353 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983257:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777580320.983277:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983313:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:3.0:1777580320.983318:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983401:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983425:0:188704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x853:0x0].0x0 (ffffa02488b85600) 00010000:00010000:3.0:1777580320.983428:0:188704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777580320.983434:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983439:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838400/0xcb2b2f2f7e4e361 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x853:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580320.983466:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.983468:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580320.983470:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580321.000294:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580321.000303:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580321.000306:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777580321.276906:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939100 is committed 00000001:00080000:0.0:1777580321.276929:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939092 is committed 00000001:00080000:0.0:1777580321.276941:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939078 is committed 00000001:00080000:0.0:1777580321.276995:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939102 is committed 00000001:00080000:0.0:1777580321.277314:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939080 is committed 00000001:00080000:3.0:1777580321.290544:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938700 is committed 00000001:00080000:3.0:1777580321.290585:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938683 is committed 00000001:00080000:3.0:1777580321.290594:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938679 is committed 00000001:00080000:3.0:1777580321.290639:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938701 is committed 00000001:00080000:3.0:1777580321.290653:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938692 is committed 00000001:00080000:3.0:1777580321.290739:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938682 is committed 00000001:00080000:3.0:1777580321.290781:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938702 is committed 00010000:00010000:2.0:1777580321.389988:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580321.964569:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580321.979820:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839168 00000100:00100000:0.0:1777580321.979839:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839168 00000100:00100000:3.0:1777580321.982827:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580321.982961:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580321.984886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580321.984965:0:187624:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839040 00000100:00100000:3.0:1777580321.984977:0:187624:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839040 00000100:00100000:0.0:1777580321.985619:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 502 00000100:00100000:1.0:1777580321.987895:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839424 00000100:00100000:1.0:1777580321.987920:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839424 00000100:00100000:1.0:1777580321.988013:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839680 00000100:00100000:1.0:1777580321.988018:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839680 00000100:00100000:3.0:1777580321.988435:0:187624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 425 00000100:00100000:3.0:1777580321.988450:0:187624:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946839040:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580321.989158:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+180:2362:x1863919946839168:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580321.989234:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+180:2362:x1863919946839168:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 3602us (24679us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580321.989245:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 502 00000100:00100000:1.0:1777580321.989966:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 332 00000100:00100000:1.0:1777580321.989980:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946839424:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580321.990041:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946839424:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 65us (7230us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580321.990050:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 332 00000100:00100000:1.0:1777580321.990075:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 333 00000100:00100000:1.0:1777580321.990085:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946839680:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580321.990155:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946839680:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 73us (7196us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580321.990164:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 333 00000100:00080000:0.0:1777580321.991144:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580321.991509:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580321.991551:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839296 00000100:00100000:0.0:1777580321.991560:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839296 00000100:00100000:0.0:1777580321.991611:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 334 00000100:00100000:0.0:1777580321.991703:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946839296:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580321.991781:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0238e36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946839296:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580321.991788:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 334 00000100:00100000:3.0:1777580321.992088:0:187624:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946839040:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 99us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580321.992104:0:187624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 425 00000100:00100000:3.0:1777580321.992192:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580321.992233:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580321.992270:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839552 00000100:00100000:3.0:1777580321.992274:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839552 00000100:00080000:1.0:1777580321.993120:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580321.994633:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 503 00000100:00100000:3.0:1777580321.994664:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:2362:x1863919946839552:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580321.994807:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+388:2362:x1863919946839552:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 161us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580321.994815:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 503 00000100:00100000:3.0:1777580321.994980:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839808 00000100:00100000:3.0:1777580321.994992:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839808 00000100:00100000:3.0:1777580321.995060:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 335 00000100:00100000:3.0:1777580321.995067:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946839808:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580321.995110:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946839808:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 44us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580321.995116:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 335 00000100:00080000:1.0:1777580321.995224:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777580322.079468:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580322.082920:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946839936 00000100:00100000:1.0:1777580322.082939:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946839936 00000100:00100000:1.0:1777580322.083057:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 877 00000100:00100000:1.0:1777580322.083090:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+180:283583:x1863919946839936:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:1.0:1777580322.083117:0:205909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580322.083172:0:205909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1ea expref: -99 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.091214:0:205909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.091250:0:205909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.092700:0:205909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580322.092947:0:205909:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00000004:00200000:1.0:1777580322.092952:0:205909:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1777580322.093049:0:205909:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.093098:0:205909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ea expref: 182 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.093122:0:205909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ea expref: 181 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.093173:0:205909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580322.093177:0:205909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777580322.093183:0:205909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc6200, rc 0) 00000100:00100000:1.0:1777580322.093306:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283583:x1863919946839936:12345-192.168.202.9@tcp:101:rm.0 Request processed in 10219us (13853us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.096918:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 877 00000100:00100000:3.0:1777580322.102044:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580322.102170:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840192 00000100:00100000:1.0:1777580322.102184:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840192 00000100:00100000:1.0:1777580322.102257:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 878 00000100:00100000:1.0:1777580322.102269:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+181:283583:x1863919946840192:12345-192.168.202.9@tcp:101:rm.0 00010000:00010000:1.0:1777580322.102297:0:187630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777580322.102495:0:187630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1f1 expref: -99 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777580322.103088:0:187630:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00010000:00010000:1.0:1777580322.107295:0:187630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e376 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1f1 expref: 183 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.107333:0:187630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024ae57bf00) 00010000:00010000:1.0:1777580322.107337:0:187630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777580322.107345:0:187630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc7000/0xcb2b2f2f7e4e376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1f1 expref: 183 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.107362:0:187630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02384dc7000, rc 0) 00000100:00100000:1.0:1777580322.107456:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283583:x1863919946840192:12345-192.168.202.9@tcp:101:rm.0 Request processed in 5189us (5425us total) trans 8589951168 rc 301/301 00000100:00100000:1.0:1777580322.107467:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 878 00000100:00100000:2.0:1777580322.114256:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.116570:0:187634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840320 00000100:00100000:3.0:1777580322.116589:0:187634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840320 00000100:00100000:3.0:1777580322.116671:0:187634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4288 00000100:00100000:3.0:1777580322.116683:0:187634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+182:283583:x1863919946840320:12345-192.168.202.9@tcp:37:rm.0 00000001:00080000:1.0:1777580322.141000:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951164 is committed 00000001:00080000:1.0:1777580322.141071:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951069 is committed 00000004:00080000:1.0:1777580322.141125:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 217 committed 00000100:00100000:3.0:1777580322.141601:0:187634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+148:283583:x1863919946840320:12345-192.168.202.9@tcp:37:rm.0 Request processed in 24910us (27351us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580322.141618:0:187634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4288 00000100:00100000:3.0:1777580322.141900:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917499136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.141973:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142043:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1777580322.142049:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917498752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142071:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142088:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917499264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142113:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142157:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917498880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142179:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142196:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142214:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142230:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777580322.142235:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142282:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.142300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.142339:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917499136 00000100:00100000:3.0:1777580322.142347:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917499136 00000100:00100000:3.0:1777580322.142399:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917498752 00000100:00100000:3.0:1777580322.142402:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917498752 00000100:00100000:3.0:1777580322.142475:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917499264 00000100:00100000:3.0:1777580322.142479:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917499264 00000100:00100000:3.0:1777580322.142495:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917498880 00000100:00100000:3.0:1777580322.142498:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917498880 00000100:00100000:3.0:1777580322.142514:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917499392 00000100:00100000:3.0:1777580322.142516:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917499392 00000100:00100000:3.0:1777580322.142530:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917499008 00000100:00100000:3.0:1777580322.142533:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917499008 00000100:00100000:3.0:1777580322.142549:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917499520 00000100:00100000:3.0:1777580322.142553:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917499520 00000100:00100000:3.0:1777580322.142572:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12227 00000100:00100000:3.0:1777580322.142581:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917499136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.142615:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5608 count 1 00010000:00010000:3.0:1777580322.142646:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142673:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142682:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.142685:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.142689:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142722:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142737:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.142777:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917499648:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.142836:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.142856:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12228 00000100:00100000:3.0:1777580322.142864:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917498752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.142877:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5607 count 1 00010000:00010000:3.0:1777580322.142890:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142903:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 19 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142909:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.142911:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.142913:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142938:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 19 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.142948:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 19 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.142958:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917499776:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.142982:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.143006:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12229 00000100:00100000:3.0:1777580322.143015:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917499264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.143027:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5610 count 1 00010000:00010000:3.0:1777580322.143040:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143053:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143060:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143061:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143064:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143083:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143092:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.143103:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917499904:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.143129:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15600 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.143173:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12230 00000100:00100000:3.0:1777580322.143181:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3288:x1863919917498880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.143194:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5606 count 1 00010000:00010000:3.0:1777580322.143205:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143224:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143231:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143232:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143235:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143257:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143266:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.143276:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917500032:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.143300:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15780 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.143319:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12231 00000100:00100000:3.0:1777580322.143327:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3288:x1863919917499392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.143340:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5611 count 1 00010000:00010000:3.0:1777580322.143352:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143364:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 19 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143381:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143382:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143385:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143403:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 19 pid: 189456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143412:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 19 pid: 189456 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.143421:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917500160:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.143446:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15240 going to sleep for 11 seconds 00000100:00080000:3.0:1777580322.143461:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777580322.143480:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12232 00000100:00100000:3.0:1777580322.143487:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+11:3288:x1863919917499008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.143501:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5609 count 1 00010000:00010000:3.0:1777580322.143514:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143526:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143532:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143542:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143545:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143565:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 19 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143575:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.143585:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917500288:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.143611:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.143629:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12233 00000100:00100000:3.0:1777580322.143638:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+11:3288:x1863919917499520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.143652:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5612 count 1 00010000:00010000:3.0:1777580322.143662:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143674:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 24 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143682:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143684:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.143686:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143703:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 24 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.143721:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 24 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.143732:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917500416:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.143774:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15b40 going to sleep for 11 seconds 00000001:00080000:1.0:1777580322.144640:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951076 is committed 00000004:00080000:1.0:1777580322.144647:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 218 committed 00000004:00080000:1.0:1777580322.144909:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 210 committed 00000100:00100000:3.0:1777580322.145507:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917500544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.145659:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.145702:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917501056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.145835:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.145866:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1777580322.145873:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917500672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.145894:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.145915:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917501184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.145933:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.145964:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917500800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.145985:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.146002:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917501312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.146020:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.146038:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777580322.146043:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917500928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.146060:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.146076:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917501440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580322.148451:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917500544 00000100:00100000:0.0:1777580322.148473:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917500544 00000100:00100000:0.0:1777580322.148865:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917501056 00000100:00100000:0.0:1777580322.148872:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917501056 00000100:00100000:0.0:1777580322.148899:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917500672 00000100:00100000:0.0:1777580322.148903:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917500672 00000100:00100000:0.0:1777580322.148916:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917501184 00000100:00100000:0.0:1777580322.148918:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917501184 00000100:00100000:0.0:1777580322.148929:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917500800 00000100:00100000:0.0:1777580322.148932:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917500800 00000100:00100000:0.0:1777580322.148940:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917501312 00000100:00100000:0.0:1777580322.148942:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917501312 00000100:00100000:0.0:1777580322.148952:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917500928 00000100:00100000:0.0:1777580322.148955:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917500928 00000100:00100000:0.0:1777580322.148973:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12234 00000100:00100000:0.0:1777580322.148984:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917500544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.149026:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5569 count 1 00000100:00100000:1.0:1777580322.150967:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12235 00000100:00100000:1.0:1777580322.151001:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917501056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.151038:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5572 count 1 00010000:00010000:0.0:1777580322.152101:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.152148:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 20 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.152158:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.152161:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.152186:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.152242:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 20 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.152257:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 20 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.152273:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917501568:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.153425:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777580322.153476:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12236 00000100:00100000:0.0:1777580322.153498:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917500672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.153532:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5570 count 1 00010000:00010000:0.0:1777580322.157429:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.157473:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 20 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.157483:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.157486:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.157490:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.157559:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 20 pid: 205900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.157595:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 20 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.157612:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917501696:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.157687:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023894233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.158571:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12237 00000100:00100000:2.0:1777580322.158589:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3290:x1863919917501184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580322.162854:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.162897:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 20 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.162906:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.162908:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.162912:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.162973:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 20 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.162989:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 20 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.163007:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917501824:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.163127:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937380c0 going to sleep for 11 seconds 00000001:00080000:1.0:1777580322.163183:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951167 is committed 00000001:00080000:1.0:1777580322.163254:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951085 is committed 00000004:00080000:1.0:1777580322.163309:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 211 committed 00000004:00080000:1.0:1777580322.163386:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 219 committed 00000004:00080000:1.0:1777580322.163416:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 212 committed 00000001:00080000:1.0:1777580322.163491:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951087 is committed 00002000:00080000:2.0:1777580322.163917:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5574 count 1 00010000:00010000:2.0:1777580322.166520:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.166559:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.166567:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.166569:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.166573:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.166635:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 20 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.166648:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 20 pid: 205907 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.166664:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917502080:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.167395:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.167468:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917501440 00000100:00100000:3.0:1777580322.167476:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917501440 00000100:00100000:3.0:1777580322.167522:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12238 00000100:00100000:3.0:1777580322.167533:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3288:x1863919917500800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580322.167566:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5568 count 1 00000100:00100000:0.0:1777580322.170629:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580322.170673:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917501952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.170792:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777580322.170834:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777580322.170852:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917501952 00000100:00100000:0.0:1777580322.170858:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917501952 00000100:00100000:0.0:1777580322.170894:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12239 00000100:00100000:0.0:1777580322.170901:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917501312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.170929:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5575 count 1 00010000:00010000:3.0:1777580322.172354:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172393:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 20 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172403:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.172405:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.172409:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172469:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 20 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172483:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 20 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.172500:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917502208:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.172615:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.172662:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12240 00000100:00100000:3.0:1777580322.172678:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917500928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580322.172756:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5573 count 1 00010000:00010000:3.0:1777580322.172810:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172826:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 20 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172833:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.172834:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.172837:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172859:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 20 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.172869:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 20 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.172878:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917502336:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.172905:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.172929:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12241 00000100:00100000:3.0:1777580322.172940:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917501440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.172957:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5614 count 1 00010000:00010000:3.0:1777580322.172976:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173001:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173008:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.173010:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.173012:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173037:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173047:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.173058:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02496fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917502464:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.173083:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.173102:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12242 00000100:00100000:3.0:1777580322.173111:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3291:x1863919917501952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580322.173124:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5577 count 1 00010000:00010000:3.0:1777580322.173169:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173183:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 24 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173203:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.173204:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.173207:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173229:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 24 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.173239:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.173248:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917502592:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.173276:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024ae4eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.173690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173709:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173735:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173830:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173874:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.173950:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917499648:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.173980:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.174906:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840448 00000100:00100000:1.0:1777580322.174922:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840448 00010000:00010000:1.0:1777580322.174986:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 20 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.175023:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840704 00000100:00100000:1.0:1777580322.175027:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840704 00010000:00010000:1.0:1777580322.175039:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 21 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.175050:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840960 00000100:00100000:1.0:1777580322.175053:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840960 00010000:00010000:1.0:1777580322.175066:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 22 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.175079:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4486 00000100:00100000:1.0:1777580322.175088:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2363:x1863919946840448:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.175108:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.175114:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 22 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175128:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 22 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175208:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4c50e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb0d expref: 22 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175245:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175247:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175253:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175264:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175341:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917499776:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175366:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175394:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917499904:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175407:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175431:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917500032:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175447:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175471:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917500160:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175483:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175508:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917500288:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175516:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175539:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917500416:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.175562:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175581:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841216 00000100:00100000:3.0:1777580322.175586:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841216 00010000:00010000:3.0:1777580322.175606:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175619:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580322.175622:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840576 00000100:00100000:3.0:1777580322.175625:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840576 00010000:00010000:3.0:1777580322.175635:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 22 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175643:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946840832 00000100:00100000:3.0:1777580322.175646:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946840832 00010000:00010000:3.0:1777580322.175654:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 23 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175662:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841088 00000100:00100000:3.0:1777580322.175665:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841088 00000100:00100000:1.0:1777580322.175680:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946840448:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 593us (1991us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580322.175689:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 25 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.175689:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4486 00000100:00100000:3.0:1777580322.175699:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841344 00000100:00100000:3.0:1777580322.175701:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841344 00000100:00100000:1.0:1777580322.175709:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4487 00010000:00010000:3.0:1777580322.175710:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 23 pid: 189456 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.175715:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2363:x1863919946840704:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.175724:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.175728:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 23 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.175736:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4488 00010000:00010000:1.0:1777580322.175737:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 23 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175765:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4c51c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb1b expref: 23 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175786:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175788:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175791:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175798:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175818:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.175838:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2363:x1863919946840704:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 123us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.175845:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4487 00000100:00100000:1.0:1777580322.175866:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4489 00000100:00100000:1.0:1777580322.175875:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2363:x1863919946841216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.175884:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.175888:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175897:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175927:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175929:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.175932:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175952:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.175965:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.175986:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2363:x1863919946841216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 112us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.175993:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4489 00000100:00100000:1.0:1777580322.176008:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4490 00000100:00100000:1.0:1777580322.176014:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2363:x1863919946840576:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.176021:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.176026:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176036:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176048:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002322aacb/0xcb2b2f2f7e4c3d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea96 expref: 21 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176057:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.176058:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.176061:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176082:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176102:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.176124:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2363:x1863919946840576:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 111us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.176131:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4490 00000100:00100000:1.0:1777580322.176189:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4491 00000100:00100000:1.0:1777580322.176197:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2363:x1863919946840832:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.176205:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.176210:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176219:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176230:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4c3e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eab2 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.176242:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.176243:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.176246:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.176672:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508180 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.180857:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.180956:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.181048:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+18:2363:x1863919946840832:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4845us (7209us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.181061:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4491 00000100:00100000:1.0:1777580322.181110:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4492 00000100:00100000:1.0:1777580322.181123:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946841088:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.181170:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.181180:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 25 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181193:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 25 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181217:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058bf3e92/0xcb2b2f2f7e4c9fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec1e expref: 25 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181235:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.181237:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.181243:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181277:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181297:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.181321:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946841088:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 203us (7474us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.181328:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4492 00000100:00100000:1.0:1777580322.181343:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4493 00000100:00100000:1.0:1777580322.181350:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+17:2362:x1863919946841344:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.181359:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.181365:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 17 pid: 189456 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181377:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 17 pid: 189456 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181391:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4c593 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb3e expref: 17 pid: 189456 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181401:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.181403:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.181406:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181425:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181444:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.181465:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2362:x1863919946841344:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 115us (7605us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.181471:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4493 00010000:00010000:1.0:1777580322.181506:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181516:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181527:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181534:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.181564:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580322.182238:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917499136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39653us (40259us total) trans 8589939103 rc 0/0 00000100:00100000:1.0:1777580322.182251:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12227 00010000:00010000:1.0:1777580322.182296:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182322:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182332:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182340:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182360:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777580322.182679:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917499264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39665us (40563us total) trans 8589939104 rc 0/0 00000100:00100000:1.0:1777580322.182686:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12229 00010000:00010000:1.0:1777580322.182712:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182722:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182730:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.182736:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.183974:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184006:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184015:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.184017:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.184022:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184061:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.184068:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184078:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.184083:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184092:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184112:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184119:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33e58cc/0xcb2b2f2f7e4e384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184161:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.184166:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184172:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.184176:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184194:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184204:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184211:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e392 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.184223:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.184224:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.184226:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.186147:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c59e3f6/0xcb2b2f2f7e4c3cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea8f expref: 20 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.186176:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0238e369500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917501568:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.186211:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.186223:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.186231:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.186266:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.186274:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.186431:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777580322.186970:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239776f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2363:x1863919946840960:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777580322.186983:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917498752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44119us (44909us total) trans 8589939105 rc 0/0 00000100:00100000:1.0:1777580322.186992:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12228 00010000:00010000:3.0:1777580322.186993:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.187229:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.187240:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.187249:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.187827:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.188394:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.188423:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777580322.188640:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.188661:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.188690:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4c52a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb06 expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.188922:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.188926:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.188932:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.188944:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.188983:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777580322.189158:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239776f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2363:x1863919946840960:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 13413us (15419us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580322.189171:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4488 00000100:00100000:3.0:1777580322.189415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189845:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189903:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189918:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189930:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.189959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:3.0:1777580322.189980:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.189992:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.190004:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.190013:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.190023:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1777580322.193666:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917500544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44565us (47886us total) trans 8589938703 rc 0/0 00000100:00100000:0.0:1777580322.193687:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12234 00010000:00010000:1.0:1777580322.193760:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.193779:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.193794:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.193829:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.193844:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1777580322.193852:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841728 00000100:00100000:0.0:1777580322.193863:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841728 00010000:00010000:0.0:1777580322.193902:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 20 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.193921:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841856 00000100:00100000:0.0:1777580322.193924:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841856 00010000:00010000:0.0:1777580322.193937:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 21 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.193947:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841984 00000100:00100000:0.0:1777580322.193950:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841984 00010000:00010000:0.0:1777580322.193961:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 22 pid: 205907 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.193971:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842240 00000100:00100000:0.0:1777580322.193979:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842240 00010000:00010000:0.0:1777580322.193994:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.194006:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842112 00000100:00100000:0.0:1777580322.194008:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842112 00010000:00010000:0.0:1777580322.194019:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 23 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194023:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.194029:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842368 00010000:00010000:1.0:1777580322.194031:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.194031:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842368 00010000:00010000:1.0:1777580322.194039:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194046:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.194047:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 25 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194055:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1777580322.194057:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842496 00000100:00100000:0.0:1777580322.194059:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842496 00010000:00010000:0.0:1777580322.194071:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.194084:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4494 00000100:00100000:0.0:1777580322.194093:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946841728:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.194108:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.194114:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 24 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.194129:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 24 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.194188:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.194191:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.194196:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.194206:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.194211:0:3290:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589938682 gen 2 00000004:00080000:1.0:1777580322.194217:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c4700, transno 8589938640 00010000:00010000:0.0:1777580322.194227:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1777580322.194235:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c4380, transno 8589938641 00000004:00080000:1.0:1777580322.194238:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c5f80, transno 8589938642 00000004:00080000:1.0:1777580322.194240:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffdc00, transno 8589938643 00000004:00080000:1.0:1777580322.194243:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c6a00, transno 8589938644 00000004:00080000:1.0:1777580322.194245:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c4000, transno 8589938645 00000004:00080000:1.0:1777580322.194248:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a2d80, transno 8589938646 00000004:00080000:1.0:1777580322.194257:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c7100, transno 8589938647 00000004:00080000:1.0:1777580322.194259:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023850c5880, transno 8589938648 00000004:00080000:1.0:1777580322.194262:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a0380, transno 8589938650 00000004:00080000:1.0:1777580322.194264:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a1880, transno 8589938651 00000004:00080000:1.0:1777580322.194267:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095c380, transno 8589938652 00000004:00080000:1.0:1777580322.194270:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a0e00, transno 8589938653 00000004:00080000:1.0:1777580322.194272:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239235d180, transno 8589938655 00000004:00080000:1.0:1777580322.194274:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a1500, transno 8589938656 00000004:00080000:1.0:1777580322.194277:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc42a00, transno 8589938657 00000004:00080000:1.0:1777580322.194279:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc40380, transno 8589938658 00000004:00080000:1.0:1777580322.194282:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02397d5df80, transno 8589938659 00000100:00100000:0.0:1777580322.194284:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+24:2361:x1863919946841728:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 192us (4871us total) trans 0 rc 0/0 00000004:00080000:1.0:1777580322.194285:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ac337100, transno 8589938660 00000004:00080000:1.0:1777580322.194288:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc42300, transno 8589938661 00000004:00080000:1.0:1777580322.194290:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc40700, transno 8589938662 00000100:00100000:0.0:1777580322.194292:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4494 00000004:00080000:1.0:1777580322.194293:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc40e00, transno 8589938663 00000004:00080000:1.0:1777580322.194295:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc40000, transno 8589938664 00000004:00080000:1.0:1777580322.194298:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cf9f80, transno 8589938665 00000004:00080000:1.0:1777580322.194301:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1673b80, transno 8589938666 00000004:00080000:1.0:1777580322.194304:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249f2b8000, transno 8589938667 00000100:00100000:0.0:1777580322.194305:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4495 00000004:00080000:1.0:1777580322.194307:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc40a80, transno 8589938668 00000004:00080000:1.0:1777580322.194309:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1670a80, transno 8589938669 00000100:00100000:0.0:1777580322.194311:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239776c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946841856:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1777580322.194312:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cfb100, transno 8589938671 00000004:00080000:1.0:1777580322.194314:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cfb800, transno 8589938672 00000004:00080000:1.0:1777580322.194317:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cf9880, transno 8589938673 00000004:00080000:1.0:1777580322.194319:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cf9180, transno 8589938674 00000004:00080000:1.0:1777580322.194322:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef92300, transno 8589938675 00000004:00080000:1.0:1777580322.194325:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02395cf9500, transno 8589938676 00000004:00080000:1.0:1777580322.194328:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239ce09f80, transno 8589938677 00000004:00080000:1.0:1777580322.194330:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239667e300, transno 8589938678 00000004:00080000:1.0:1777580322.194334:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023864a1f80, transno 8589938679 00000100:00100000:1.0:1777580322.194361:0:3290:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa024b7dfaa00 x1863919917500544/t8589938703(8589938703) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580338 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777580322.194374:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfaa00/2, rc 0, transno 8589938703 00000100:00100000:1.0:1777580322.194380:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917500544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580322.194400:0:3290:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589939080 gen 2 00000004:00080000:1.0:1777580322.194403:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae6aed80, transno 8589939040 00000004:00080000:1.0:1777580322.194417:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae4b6d80, transno 8589939041 00000004:00080000:1.0:1777580322.194421:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02484c10a80, transno 8589939042 00000004:00080000:1.0:1777580322.194423:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384fff100, transno 8589939043 00000004:00080000:1.0:1777580322.194426:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c63aa00, transno 8589939044 00000004:00080000:1.0:1777580322.194429:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d880, transno 8589939045 00000004:00080000:1.0:1777580322.194431:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a1c00, transno 8589939046 00000004:00080000:1.0:1777580322.194434:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a2680, transno 8589939047 00000004:00080000:1.0:1777580322.194436:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023863a0a80, transno 8589939048 00000004:00080000:1.0:1777580322.194439:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffca80, transno 8589939049 00000004:00080000:1.0:1777580322.194442:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae6ac000, transno 8589939050 00000004:00080000:1.0:1777580322.194451:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ed80, transno 8589939053 00000004:00080000:1.0:1777580322.194454:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024acde0000, transno 8589939054 00000004:00080000:1.0:1777580322.194457:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae685c00, transno 8589939055 00000004:00080000:1.0:1777580322.194460:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ae4b5c00, transno 8589939056 00000004:00080000:1.0:1777580322.194463:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095fb80, transno 8589939057 00000004:00080000:1.0:1777580322.194465:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f100, transno 8589939058 00000004:00080000:1.0:1777580322.194468:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c2300, transno 8589939059 00000004:00080000:1.0:1777580322.194471:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f800, transno 8589939060 00000004:00080000:1.0:1777580322.194474:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc41c00, transno 8589939061 00000004:00080000:1.0:1777580322.194476:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc41500, transno 8589939062 00000004:00080000:1.0:1777580322.194480:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02486243800, transno 8589939064 00000004:00080000:1.0:1777580322.194483:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023d1672680, transno 8589939065 00000004:00080000:1.0:1777580322.194485:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239e024a80, transno 8589939066 00000004:00080000:1.0:1777580322.194494:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239e024000, transno 8589939067 00000004:00080000:1.0:1777580322.194496:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02486242680, transno 8589939068 00000004:00080000:1.0:1777580322.194499:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249dc43100, transno 8589939069 00000004:00080000:1.0:1777580322.194502:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985fa680, transno 8589939070 00000004:00080000:1.0:1777580322.194505:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4000, transno 8589939071 00000004:00080000:1.0:1777580322.194508:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e7100, transno 8589939072 00000004:00080000:1.0:1777580322.194510:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e6680, transno 8589939073 00000004:00080000:1.0:1777580322.194513:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aef90700, transno 8589939074 00000004:00080000:1.0:1777580322.194516:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023985f9c00, transno 8589939075 00000004:00080000:1.0:1777580322.194518:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e5c00, transno 8589939076 00000004:00080000:1.0:1777580322.194521:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4700, transno 8589939077 00000004:00080000:1.0:1777580322.194524:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e7800, transno 8589939078 00000004:00080000:1.0:1777580322.194526:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0239667c700, transno 8589939080 00000100:00100000:1.0:1777580322.194531:0:3290:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa02388925c00 x1863919917498752/t8589939105(8589939105) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580338 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777580322.194540:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388925c00/2, rc 0, transno 8589939105 00000100:00100000:1.0:1777580322.194544:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917498752:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580322.194559:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388927480/2, rc 0, transno 8589939104 00000100:00100000:1.0:1777580322.194563:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917499264:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580322.194573:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388925500/2, rc 0, transno 8589939103 00000100:00100000:1.0:1777580322.194576:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917499136:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777580322.194594:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1777580322.194602:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194611:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.194616:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194633:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194647:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194654:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e3b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194680:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1777580322.194684:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194691:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.194693:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194701:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194710:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.194718:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e38b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.194863:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917499008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51376us (52595us total) trans 8589939106 rc 0/0 00000100:00100000:3.0:1777580322.194872:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12232 00000100:00100000:3.0:1777580322.194918:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:188248:1863919917502080:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.194935:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.195971:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.195982:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196000:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196023:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196025:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196030:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196059:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196082:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.196128:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239776c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+23:2362:x1863919946841856:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1816us (6393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.196151:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4495 00000100:00100000:0.0:1777580322.196210:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4496 00000100:00100000:0.0:1777580322.196221:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+22:2362:x1863919946841984:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.196228:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.196233:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 22 pid: 205907 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196245:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 22 pid: 205907 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196258:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003277ca1f/0xcb2b2f2f7e4c6f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb4c expref: 22 pid: 205907 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196274:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196276:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196279:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196299:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196311:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.196343:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+21:2362:x1863919946841984:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 125us (6498us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.196348:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4496 00000100:00100000:0.0:1777580322.196362:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4497 00000100:00100000:0.0:1777580322.196369:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946842240:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.196377:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.196384:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196395:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196409:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196411:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196414:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196423:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196434:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.196456:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2364:x1863919946842240:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 88us (6552us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.196462:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4497 00000100:00100000:0.0:1777580322.196474:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4498 00000100:00100000:0.0:1777580322.196480:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946842112:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.196487:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.196492:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 20 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196502:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 20 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196514:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196516:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.196519:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196527:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.196538:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.197006:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+20:2362:x1863919946842112:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 523us (7084us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.197014:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4498 00000100:00100000:0.0:1777580322.197031:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4499 00000100:00100000:0.0:1777580322.197038:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946842368:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.197056:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.197063:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 25 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197075:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 25 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197089:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.197091:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.197095:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197102:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197115:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.197220:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2362:x1863919946842368:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 97us (7203us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.197227:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4499 00000100:00100000:0.0:1777580322.197243:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4500 00000100:00100000:0.0:1777580322.197250:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2361:x1863919946842496:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.197257:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.197263:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197274:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 19 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197292:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.197294:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.197297:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197306:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.197976:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.198019:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+19:2361:x1863919946842496:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 767us (8057us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.198027:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4500 00000100:00100000:0.0:1777580322.198080:0:206054:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946841600 00000100:00100000:0.0:1777580322.198089:0:206054:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946841600 00000100:00100000:0.0:1777580322.198164:0:206054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4289 00000100:00100000:0.0:1777580322.198172:0:206054:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:283583:x1863919946841600:12345-192.168.202.9@tcp:35:rm.0 00010000:00010000:3.0:1777580322.199210:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.199217:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.199227:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.199235:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.199252:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1777580322.201178:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917501184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42588us (55234us total) trans 8589938704 rc 0/0 00000100:00100000:3.0:1777580322.201191:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12237 00010000:00010000:3.0:1777580322.201287:0:189456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fa872b/0xcb2b2f2f7e4c523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb14 expref: 18 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.201307:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917502336:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.201677:0:206054:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aec3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:283583:x1863919946841600:12345-192.168.202.9@tcp:35:rm.0 Request processed in 3503us (27798us total) trans 8589951169 rc 0/0 00000100:00100000:0.0:1777580322.201688:0:206054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4289 00010000:00010000:0.0:1777580322.201939:0:205900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dfd8227/0xcb2b2f2f7e4c3da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea9d expref: 17 pid: 205900 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.201957:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917501696:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.201984:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.202011:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.202018:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.202029:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.202039:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.202055:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1777580322.202495:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.202504:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.204089:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917500672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50592us (58183us total) trans 8589938705 rc 0/0 00000100:00100000:0.0:1777580322.204105:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12236 00000100:00080000:0.0:1777580322.204185:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777580322.204192:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777580322.204206:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1777580322.204216:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.204230:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.204236:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.204269:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.204295:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.204303:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e399 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205121:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580322.205127:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205176:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.205180:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205189:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205205:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205213:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3036f4e/0xcb2b2f2f7e4e3a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205249:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580322.205253:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205260:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.205263:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205270:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205281:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205287:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f759f69a/0xcb2b2f2f7e4e3ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.205302:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777580322.206126:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.206149:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.206156:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.206172:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1777580322.207285:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207306:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.207324:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207361:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207386:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207393:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000262a4562/0xcb2b2f2f7e4e3a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207428:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580322.207433:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207440:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.207443:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207449:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207459:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207466:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e3ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207522:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.207527:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207534:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.207537:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207554:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207565:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207572:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e3bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207592:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.207595:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207601:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.207605:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207625:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207636:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207644:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e3d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.207660:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.207662:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.207665:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.207682:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580322.208179:0:187652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 27 changes, 8 in progress, 5 in flight, 37 done 00010000:00010000:0.0:1777580322.208283:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580322.208940:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfa300/2, rc 0, transno 8589938705 00000100:00100000:1.0:1777580322.208958:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917500672:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580322.208972:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfa680/2, rc 0, transno 8589938704 00000100:00100000:1.0:1777580322.208976:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917501184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580322.208983:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580322.209002:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917502720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580322.209081:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.209166:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917502720 00000100:00100000:1.0:1777580322.209175:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917502720 00000100:00100000:1.0:1777580322.209231:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12243 00000100:00100000:1.0:1777580322.209242:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3290:x1863919917502720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.209278:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5613 count 1 00010000:00010000:1.0:1777580322.209310:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.209344:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.209354:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.209357:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.209361:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.209398:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.209442:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.209456:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917503104:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.209510:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937386c0 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.209528:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.209530:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.209532:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580322.212152:0:187654:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 28 changes, 8 in progress, 5 in flight, 37 done 00000100:00100000:1.0:1777580322.212277:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917503232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580322.212361:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.212413:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580322.212420:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917503360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580322.212442:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.212477:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917503232 00000100:00100000:1.0:1777580322.212485:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917503232 00000100:00100000:1.0:1777580322.212532:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917503360 00000100:00100000:1.0:1777580322.212535:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917503360 00000100:00100000:1.0:1777580322.212560:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12244 00000100:00100000:1.0:1777580322.212570:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3290:x1863919917503232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.212602:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5576 count 1 00010000:00010000:1.0:1777580322.212634:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212662:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212682:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.212684:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.212688:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212722:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212735:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.212760:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917503616:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.212796:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738300 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.212842:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12245 00000100:00100000:1.0:1777580322.212854:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3290:x1863919917503360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.212867:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5578 count 1 00010000:00010000:1.0:1777580322.212881:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212893:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212900:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.212901:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.212910:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212933:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.212943:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.212953:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917503744:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.212976:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738780 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.213080:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917498880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 69899us (70898us total) trans 8589939107 rc 0/0 00000100:00100000:1.0:1777580322.213088:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12230 00000100:00100000:0.0:1777580322.215094:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917502976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580322.215201:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.215252:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777580322.215259:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917502848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580322.215281:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.215301:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917503488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777580322.215991:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3288:x1863919917500928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43316us (69926us total) trans 8589938706 rc 0/0 00000100:00100000:3.0:1777580322.216003:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12240 00000100:00100000:3.0:1777580322.216032:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917502976 00000100:00100000:3.0:1777580322.216041:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917502976 00000100:00100000:3.0:1777580322.216081:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917502848 00000100:00100000:3.0:1777580322.216083:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917502848 00000100:00100000:3.0:1777580322.216103:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12246 00000100:00100000:3.0:1777580322.216110:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917502976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.216155:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5616 count 1 00010000:00010000:3.0:1777580322.216182:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.216206:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 23 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.216228:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.216231:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.216235:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.216272:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 23 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.216285:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 23 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.216299:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917503872:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.216389:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917499520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72750us (74085us total) trans 8589939108 rc 0/0 00000100:00100000:1.0:1777580322.216397:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12233 00000100:00100000:1.0:1777580322.216414:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12247 00000100:00100000:1.0:1777580322.216422:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917502848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.216435:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5615 count 1 00010000:00010000:1.0:1777580322.216447:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.216460:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 23 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.216480:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.216481:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.216484:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.216503:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 23 pid: 205906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.216513:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 23 pid: 205906 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.216523:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917504000:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.216568:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738540 going to sleep for 11 seconds 00000100:00100000:0.0:1777580322.217975:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.218045:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917503488 00000100:00100000:0.0:1777580322.218053:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917503488 00000100:00100000:0.0:1777580322.218101:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12248 00000100:00100000:0.0:1777580322.218129:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3289:x1863919917503488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.218173:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5579 count 1 00010000:00010000:0.0:1777580322.218200:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.218224:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.218233:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.218234:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.218237:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.218273:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.218287:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.218300:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917504128:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.219814:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e153c0 going to sleep for 11 seconds 00010000:00010000:3.0:1777580322.219892:0:205905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ab82bce/0xcb2b2f2f7e4ca24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec48 expref: 23 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.219913:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02496fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917502464:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.219943:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.219954:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.219961:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.219992:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.220001:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.220031:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580322.220470:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023894233c0 going to sleep for 11 seconds 00010000:00010000:0.0:1777580322.221502:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.221515:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.221529:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0e00 already unused, calling callback (ffffffffc157f320) 00000100:00100000:1.0:1777580322.221988:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917499392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 78656us (79765us total) trans 8589939109 rc 0/0 00000100:00100000:1.0:1777580322.222000:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12231 00010000:00010000:0.0:1777580322.222059:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.222071:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222075:0:205896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008072f7e3/0xcb2b2f2f7e4c546 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eb29 expref: 16 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.222091:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917501824:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.222093:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.222099:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e3df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222116:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.222120:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.222122:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.222123:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.222126:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222163:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222173:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222181:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222213:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580322.222687:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1863919917501056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 71704us (76851us total) trans 8589938707 rc 0/0 00000100:00100000:1.0:1777580322.222696:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12235 00000004:00080000:1.0:1777580322.222762:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7df9f80/2, rc 0, transno 8589938707 00000100:00100000:1.0:1777580322.222776:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917501056:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580322.222952:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.222957:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.222958:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.222974:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.222990:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917504384:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.223050:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00010000:00010000:0.0:1777580322.227583:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.227593:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.227607:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.227635:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.227670:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a331869/0xcb2b2f2f7e4e3c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.227711:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.227714:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.227717:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580322.227766:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917504256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.227859:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.227953:0:188247:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917504256 00000100:00100000:1.0:1777580322.227970:0:188247:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917504256 00000100:00100000:1.0:1777580322.228028:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12249 00000100:00100000:1.0:1777580322.228040:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3289:x1863919917504256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.228080:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5581 count 1 00010000:00010000:1.0:1777580322.228105:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.228129:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 24 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.228157:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.228160:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.228164:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.229910:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 24 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.229935:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 24 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.229953:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917504512:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.230066:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.230673:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3288:x1863919917501440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57732us (63276us total) trans 8589939110 rc 0/0 00000100:00100000:3.0:1777580322.230686:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12241 00010000:00010000:3.0:1777580322.230773:0:206018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dd9f1a4/0xcb2b2f2f7e4ca08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec25 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.230790:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917502592:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.230820:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.230831:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.230840:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.230851:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.230875:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.230903:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580322.231302:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+17:3291:x1863919917501952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58192us (60510us total) trans 8589938708 rc 0/0 00000100:00100000:3.0:1777580322.235241:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12242 00000004:00080000:0.0:1777580322.236800:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d500/2, rc 0, transno 8589938708 00000100:00100000:0.0:1777580322.236830:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917501952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.236957:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580322.236969:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917504640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.237041:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.237085:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917504640 00000100:00100000:0.0:1777580322.237092:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917504640 00000100:00100000:0.0:1777580322.237232:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12250 00000100:00100000:0.0:1777580322.237242:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1863919917504640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.237275:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5580 count 1 00010000:00010000:0.0:1777580322.237308:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237337:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237347:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.237369:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.237374:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237409:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 23 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237423:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 23 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.237438:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917504768:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.237498:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777580322.237674:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.237698:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842624 00000100:00100000:0.0:1777580322.237703:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842624 00010000:00010000:0.0:1777580322.237726:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.237767:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4501 00000100:00100000:0.0:1777580322.237777:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946842624:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.237787:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.237793:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237807:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 23 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237845:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.237847:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.237851:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237862:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.237881:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.237911:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946842624:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 136us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.237920:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4501 00000100:00100000:0.0:1777580322.238173:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917504128:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.238200:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.238277:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842752 00000100:00100000:0.0:1777580322.238281:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842752 00010000:00010000:0.0:1777580322.238297:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238321:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4502 00000100:00100000:0.0:1777580322.238328:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239776f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946842752:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.238335:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.238348:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238357:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.238364:0:205906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c12acd/0xcb2b2f2f7e4ca0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec2c expref: 22 pid: 205896 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238372:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238373:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238377:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.238379:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917503104:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.238384:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238396:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580322.238401:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.238409:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238414:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239776f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946842752:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 87us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580322.238417:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238421:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4502 00010000:00010000:1.0:1777580322.238428:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.238436:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.238453:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580322.238484:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.238500:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843008 00000100:00100000:0.0:1777580322.238504:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843008 00010000:00010000:0.0:1777580322.238522:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 22 pid: 205906 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238542:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4503 00000100:00100000:0.0:1777580322.238547:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2363:x1863919946843008:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.238553:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.238563:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 22 pid: 205906 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238571:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 22 pid: 205906 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238583:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238585:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238588:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238595:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238606:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.238623:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2363:x1863919946843008:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 76us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.238629:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4503 00000100:00100000:0.0:1777580322.238676:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.238690:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843264 00000100:00100000:0.0:1777580322.238693:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843264 00010000:00010000:0.0:1777580322.238705:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.238723:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4504 00000100:00100000:0.0:1777580322.238729:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946843264:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.238735:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.238756:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238766:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238778:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000451a871a/0xcb2b2f2f7e4cf09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed21 expref: 24 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238788:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238790:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.238792:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238800:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238816:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.238834:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2363:x1863919946843264:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 105us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.238840:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4504 00010000:00010000:0.0:1777580322.238860:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238868:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238887:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238893:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.238906:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1777580322.238968:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3290:x1863919917502720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29728us (29887us total) trans 8589939111 rc 0/0 00000100:00100000:1.0:1777580322.238977:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12243 00010000:00010000:1.0:1777580322.239012:0:193009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7f2498a/0xcb2b2f2f7e4ca1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec41 expref: 22 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.239023:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:193009:1863919917503616:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.239035:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239055:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239061:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239070:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239078:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239091:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1777580322.239217:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3289:x1863919917503488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21091us (21246us total) trans 8589938709 rc 0/0 00000100:00100000:0.0:1777580322.239224:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12248 00010000:00010000:0.0:1777580322.239242:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580322.239251:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239260:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.239265:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239275:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239288:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239296:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bdfeb67/0xcb2b2f2f7e4e3e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239323:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580322.239327:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239333:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc7600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.239336:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239343:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239354:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239360:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fae13c/0xcb2b2f2f7e4e3f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.239364:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3290:x1863919917503232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26796us (27003us total) trans 8589938710 rc 0/0 00000100:00100000:1.0:1777580322.239371:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12244 00010000:00010000:0.0:1777580322.239375:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.239378:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239384:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.239387:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239405:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239408:0:206023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4cef4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed0c expref: 21 pid: 205906 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239416:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.239419:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917504000:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.239423:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a60274/0xcb2b2f2f7e4e417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239431:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239435:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.239438:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239439:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239444:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.239448:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239452:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239456:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239460:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239464:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239467:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239471:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038cbe4f6/0xcb2b2f2f7e4e3fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239476:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580322.239495:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.239499:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239505:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.239508:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239515:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239525:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239532:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000f44c7b/0xcb2b2f2f7e4e410 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.239545:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.239546:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.239548:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.239554:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580322.239580:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095ed80/2, rc 0, transno 8589938709 00000100:00100000:0.0:1777580322.239594:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917503488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.239667:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917504896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.239703:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.239720:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+16:3289:x1863919917502848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23298us (24437us total) trans 8589939112 rc 0/0 00000100:00100000:1.0:1777580322.239726:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12247 00000100:00100000:1.0:1777580322.239757:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917504896 00000100:00100000:1.0:1777580322.239761:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917504896 00000100:00100000:1.0:1777580322.239789:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12251 00000100:00100000:1.0:1777580322.239795:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+18:3291:x1863919917504896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.239817:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5582 count 1 00010000:00010000:1.0:1777580322.239841:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239857:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239865:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.239873:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.239876:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239901:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 21 pid: 205895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.239913:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 21 pid: 205895 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.239923:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917505024:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.239962:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023937383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.239992:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917503744:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.240007:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.240024:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580322.240041:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917504384:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.240054:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.240068:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580322.240271:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ab534da/0xcb2b2f2f7e4c3a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ea88 expref: 15 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.240285:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917502208:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.240301:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.240328:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.240335:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.240343:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.241984:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.242046:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580322.247942:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3288:x1863919917500800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 80397us (101941us total) trans 8589938711 rc 0/0 00000100:00100000:3.0:1777580322.247960:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12238 00000100:00100000:3.0:1777580322.248076:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580322.253452:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.253475:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.253526:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.253533:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.253547:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.253575:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.253584:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e3d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.253649:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.253651:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.253653:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580322.253729:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095c380/2, rc 0, transno 8589938710 00000100:00100000:1.0:1777580322.253761:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917503232:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580322.253779:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384fff100/2, rc 0, transno 8589939111 00000100:00100000:1.0:1777580322.253790:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917502720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.259267:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.259300:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.260639:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.260931:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.260956:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.261897:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000004:00080000:3.0:1777580322.261985:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7dfad80/2, rc 0, transno 8589938706 00000100:00100000:3.0:1777580322.261995:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917500928:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1777580322.262011:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1ce00/2, rc 0, transno 8589939110 00000100:00100000:3.0:1777580322.262016:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917501440:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1777580322.262027:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b7df8a80/2, rc 0, transno 8589938711 00000100:00100000:3.0:1777580322.262030:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917500800:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1777580322.262041:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388926300/2, rc 0, transno 8589939106 00000100:00100000:3.0:1777580322.262044:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499008:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1777580322.262053:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388927100/2, rc 0, transno 8589939108 00000100:00100000:3.0:1777580322.262056:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499520:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1777580322.262064:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388926a00/2, rc 0, transno 8589939107 00000100:00100000:3.0:1777580322.262067:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917498880:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1777580322.263929:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388924a80/2, rc 0, transno 8589939109 00000100:00100000:3.0:1777580322.263938:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917499392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.264002:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:189456:1863919917503872:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.264036:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264693:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946842880 00000100:00100000:0.0:1777580322.264704:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946842880 00010000:00010000:0.0:1777580322.264855:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 22 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264884:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843136 00000100:00100000:0.0:1777580322.264887:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843136 00010000:00010000:0.0:1777580322.264900:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 21 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264911:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843392 00000100:00100000:0.0:1777580322.264914:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843392 00010000:00010000:0.0:1777580322.264924:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 23 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264934:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843904 00000100:00100000:0.0:1777580322.264936:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843904 00010000:00010000:0.0:1777580322.264948:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 24 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264958:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843776 00000100:00100000:0.0:1777580322.264960:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843776 00010000:00010000:0.0:1777580322.264971:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 25 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.264981:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844032 00000100:00100000:0.0:1777580322.264983:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844032 00010000:00010000:0.0:1777580322.264993:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 26 pid: 205895 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.265685:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4505 00000100:00100000:0.0:1777580322.265701:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+26:2363:x1863919946842880:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777580322.265990:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946843648 00000100:00100000:1.0:1777580322.265998:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946843648 00000100:00100000:1.0:1777580322.266035:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 879 00000100:00100000:1.0:1777580322.266042:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+33:283583:x1863919946843648:12345-192.168.202.9@tcp:36:rm.0 00010000:00010000:1.0:1777580322.266117:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1777580322.266163:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02384dc6200/0xcb2b2f2f7e4e36f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ea expref: 33 pid: 205909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266203:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02392cb2a00/0xcb2b2f2f7e457a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90d0a3 expref: 32 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266218:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580322.266229:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54e4e00/0xcb2b2f2f7dc8346 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec6dd expref: 31 pid: 187630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266238:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024ae57bf00) 00010000:00010000:1.0:1777580322.266242:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580322.266278:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266293:0:187631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 308 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266304:0:187631:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266336:0:187631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 308 pid: 191688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.266348:0:187631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 308 pid: 191688 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.266395:0:187631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917505280:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.266502:0:187631:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738840 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.266549:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917504512:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.266571:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.266605:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917505024:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.266618:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267056:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.267067:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 26 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267081:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 26 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267100:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e110d983/0xcb2b2f2f7e4ca16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ec33 expref: 26 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267115:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.267117:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.267123:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267146:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.267178:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.267222:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+25:2363:x1863919946842880:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1528us (19149us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.267232:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4505 00000100:00100000:0.0:1777580322.267282:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4506 00000100:00100000:0.0:1777580322.267294:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2363:x1863919946843136:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.267304:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777580322.269368:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917505536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580322.269469:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.269520:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777580322.269526:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917505664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580322.269548:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777580322.269587:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.269602:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.269615:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.269647:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.269668:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580322.270236:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3290:x1863919917503360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57385us (57790us total) trans 8589938712 rc 0/0 00000100:00100000:1.0:1777580322.270249:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12245 00000100:00100000:1.0:1777580322.270281:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505536 00000100:00100000:1.0:1777580322.270291:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505536 00000100:00100000:1.0:1777580322.270329:0:205907:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505664 00000100:00100000:1.0:1777580322.270332:0:205907:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505664 00000100:00100000:1.0:1777580322.270354:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12252 00000100:00100000:1.0:1777580322.270363:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3290:x1863919917505536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.270396:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5620 count 1 00000100:00100000:3.0:1777580322.271249:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.271344:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.271382:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.271403:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.271435:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777580322.271443:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02496fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.271464:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.271484:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024aec39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505920:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.271508:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580322.271564:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505152 00000100:00100000:3.0:1777580322.271571:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505152 00000100:00100000:3.0:1777580322.271614:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505792 00000100:00100000:3.0:1777580322.271617:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505792 00000100:00100000:3.0:1777580322.271630:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505408 00000100:00100000:3.0:1777580322.271633:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505408 00000100:00100000:3.0:1777580322.271645:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917505920 00000100:00100000:3.0:1777580322.271647:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917505920 00000100:00100000:3.0:1777580322.271662:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12253 00000100:00100000:3.0:1777580322.271670:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3290:x1863919917505664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.271696:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5619 count 1 00010000:00010000:3.0:1777580322.271751:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.271751:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.271777:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 21 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.271777:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 21 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.271787:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.271787:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.271789:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.271789:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.271794:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.271794:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.271831:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 21 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.271831:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 21 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.271844:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 21 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.271846:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 21 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.271857:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917506048:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.271857:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917506176:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.274882:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.274943:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12254 00000100:00100000:3.0:1777580322.274967:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917505152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777580322.275010:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5617 count 1 00010000:00010000:3.0:1777580322.275044:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.275073:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.275106:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.275109:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.275114:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.275181:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 21 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.275194:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 21 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.275210:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917506304:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.275302:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 21 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.275320:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 21 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.275344:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3c5207/0xcb2b2f2f7e4cefb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed13 expref: 21 pid: 206352 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.275362:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.275364:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.275369:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.275379:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.275416:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.277242:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12255 00000100:00100000:2.0:1777580322.277271:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917505792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580322.277980:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5621 count 1 00010000:00010000:2.0:1777580322.278016:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.278072:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 20 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.278083:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.278085:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.278090:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.278174:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 20 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.278187:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 20 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.278204:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917506432:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.278491:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.278526:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12256 00000100:00100000:1.0:1777580322.278541:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917505408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.278565:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5618 count 1 00010000:00010000:1.0:1777580322.278578:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.278592:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.278599:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.278600:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.278602:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.278623:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.278632:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.278658:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917506560:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.278684:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.278702:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e15600 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.278705:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12257 00000100:00100000:1.0:1777580322.278713:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3288:x1863919917505920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.278727:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5624 count 1 00000004:00080000:3.0:1777580322.279922:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffca80/2, rc 0, transno 8589939112 00000100:00100000:3.0:1777580322.279942:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917502848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777580322.281016:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.284224:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.284249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00010000:00010000:1.0:1777580322.285206:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.285233:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388925f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917506048:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.285239:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.285247:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.285249:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.285262:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.285266:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.285316:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.285330:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 13 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.285347:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917506816:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.289221:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2363:x1863919946843136:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 21908us (29949us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.289242:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4506 00000100:00100000:0.0:1777580322.289298:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844160 00000100:00100000:0.0:1777580322.289631:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844160 00010000:00010000:0.0:1777580322.289683:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 309 pid: 191688 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.289751:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844416 00000100:00100000:0.0:1777580322.289755:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844416 00010000:00010000:0.0:1777580322.289776:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 20 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.289791:0:189815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844544 00000100:00100000:0.0:1777580322.289794:0:189815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844544 00010000:00010000:0.0:1777580322.289808:0:189815:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 21 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.289823:0:189815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4507 00000100:00100000:0.0:1777580322.289834:0:189815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+24:2363:x1863919946843392:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.289851:0:189815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.289859:0:189815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.289876:0:189815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.289906:0:189815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0646e52/0xcb2b2f2f7e4c856 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eba7 expref: 24 pid: 188247 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.289928:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.289931:0:189815:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.289938:0:189815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.289956:0:189815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.289998:0:189815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.290664:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508240 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.290664:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738780 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.290704:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4508 00000100:00100000:1.0:1777580322.290756:0:187631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0239667e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917505280:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.290788:0:187631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.290817:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946843904:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777580322.290817:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917506560:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.290830:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.290831:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.290837:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 23 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.290846:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 23 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.290859:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917506688:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580322.290877:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.290878:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.290882:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.290890:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.290904:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.290922:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.290939:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+23:2361:x1863919946843904:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 127us (30008us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.290946:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4508 00000100:00100000:2.0:1777580322.290970:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4509 00000004:00080000:1.0:1777580322.290973:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d880/2, rc 0, transno 8589938712 00000100:00100000:2.0:1777580322.290976:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239776d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+22:2361:x1863919946843776:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777580322.290980:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917503360:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580322.290984:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.290990:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 22 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291000:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 22 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.291003:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917506688 00000100:00100000:1.0:1777580322.291007:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917506688 00010000:00010000:2.0:1777580322.291013:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc61e10/0xcb2b2f2f7e4cf02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed1a expref: 22 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.291036:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12258 00010000:00010000:2.0:1777580322.291040:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.291041:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580322.291042:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3290:x1863919917506688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777580322.291045:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291052:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1777580322.291068:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5622 count 1 00010000:00010000:2.0:1777580322.291071:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.291092:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239776d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2361:x1863919946843776:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 116us (30134us total) trans 0 rc 0/0 00010000:00010000:1.0:1777580322.291094:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.291099:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4509 00010000:00010000:1.0:1777580322.291111:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.291114:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4510 00010000:00010000:1.0:1777580322.291118:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.291119:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1777580322.291121:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2361:x1863919946844032:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.291122:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291128:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.291153:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 20 pid: 205895 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291163:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 20 pid: 205895 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291174:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f177b7/0xcb2b2f2f7e4cf64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed44 expref: 20 pid: 205895 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.291179:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291197:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.291198:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.291202:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291209:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291228:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.291247:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2361:x1863919946844032:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 126us (29355us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.291253:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4510 00000100:00100000:2.0:1777580322.291267:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4511 00000100:00100000:2.0:1777580322.291275:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+309:2362:x1863919946844160:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.291284:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.291291:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 309 pid: 191688 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291301:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 309 pid: 191688 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291334:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0a00/0xcb2b2f2f7dc8b81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec968 expref: 309 pid: 191688 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291349:0:187617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024ae57bf00) 00010000:00010000:2.0:1777580322.291360:0:187617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291369:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291376:0:187617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291395:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.291416:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+308:2362:x1863919946844160:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 141us (10407us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.291423:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4511 00000100:00100000:2.0:1777580322.291437:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4512 00000100:00100000:2.0:1777580322.291443:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2362:x1863919946844416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.291451:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.291456:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 21 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291466:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 21 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291479:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.291480:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.291483:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291490:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.291508:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.291524:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+21:2362:x1863919946844416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 81us (7317us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.291529:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4512 00000100:00100000:2.0:1777580322.291701:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4513 00000100:00100000:2.0:1777580322.292212:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+20:2362:x1863919946844544:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.292224:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.292230:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292243:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292258:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116a2233/0xcb2b2f2f7e4cf3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed36 expref: 20 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292271:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.292273:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.292276:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292284:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292491:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.292529:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2362:x1863919946844544:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 819us (8277us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.292536:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4513 00010000:00010000:2.0:1777580322.292829:0:187631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292838:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292870:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292882:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.292893:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.293272:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.293286:0:187631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 307 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.293294:0:187631:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.293648:0:187631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 307 pid: 187631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.293663:0:187631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 307 pid: 187631 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.293689:0:187631:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917507072:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.294046:0:189815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2363:x1863919946843392:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 4211us (34741us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.294057:0:189815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4507 00010000:00010000:1.0:1777580322.294123:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.294149:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917506944:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.294234:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.294599:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917506304:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.294633:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.300019:0:187631:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508180 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.300070:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844288 00000100:00100000:2.0:1777580322.300081:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844288 00010000:00010000:2.0:1777580322.300159:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.300196:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4514 00000100:00100000:2.0:1777580322.300206:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2362:x1863919946844288:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.300222:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.300228:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300244:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300274:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8716904/0xcb2b2f2f7e4d14e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed9f expref: 19 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300294:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.300296:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.300302:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300356:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300387:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.300417:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2362:x1863919946844288:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 213us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.300425:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4514 00010000:00010000:2.0:1777580322.300457:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300467:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300478:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300487:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.300509:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1777580322.302873:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3290:x1863919917505664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31192us (33312us total) trans 8589939113 rc 0/0 00000100:00100000:2.0:1777580322.302890:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12253 00010000:00010000:2.0:1777580322.302953:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.302985:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.302996:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.303004:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.303023:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1777580322.305638:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.305665:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.305677:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.305685:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.305825:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1777580322.307167:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3288:x1863919917505408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28623us (35692us total) trans 8589939114 rc 0/0 00000100:00100000:2.0:1777580322.310146:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12256 00000100:00100000:0.0:1777580322.310430:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3289:x1863919917502976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 94315us (95224us total) trans 8589939115 rc 0/0 00000100:00100000:0.0:1777580322.310443:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12246 00010000:00010000:0.0:1777580322.310518:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580322.310529:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310827:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02384dc6000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.310833:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310844:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310867:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310874:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773408ae/0xcb2b2f2f7e4e402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310902:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580322.310907:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310914:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.310917:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310925:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310936:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310951:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5146477/0xcb2b2f2f7e4e441 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310970:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.310974:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310980:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.310983:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.310991:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311001:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311008:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e456 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311022:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.311026:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311032:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.311042:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311050:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311060:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311066:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b9afb9d/0xcb2b2f2f7e4e409 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.311082:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.311083:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.311085:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580322.311179:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffe680/2, rc 0, transno 8589939115 00000100:00100000:0.0:1777580322.311198:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917502976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580322.311403:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917507200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580322.311469:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777580322.311514:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580322.313787:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.313836:0:205895:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917507200 00000100:00100000:1.0:1777580322.313849:0:205895:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917507200 00000100:00100000:1.0:1777580322.313927:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12259 00000100:00100000:1.0:1777580322.313939:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3291:x1863919917507200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.313980:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5623 count 1 00010000:00010000:1.0:1777580322.314013:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314046:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314055:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.314057:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.314060:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314100:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314163:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 13 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.314179:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917507328:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.314381:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738840 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.314429:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7b4d62/0xcb2b2f2f7e4d19b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edbb expref: 17 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.314445:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:205907:1863919917506176:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.314468:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314478:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314485:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314496:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314504:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.314535:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580322.314552:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4cf41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed3d expref: 17 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.314570:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917504768:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.314592:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.314612:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.314619:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.314626:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.314633:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.314646:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1777580322.314895:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02496fc8700/2, rc 0, transno 8589939114 00000100:00100000:2.0:1777580322.314912:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02496fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580322.315052:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+24:3290:x1863919917505536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44689us (45581us total) trans 8589939116 rc 0/0 00000100:00100000:1.0:1777580322.315061:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12252 00000100:00100000:1.0:1777580322.315104:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917506816:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.315121:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.315195:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.315223:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.315245:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.315367:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917507456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.315400:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.315429:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580322.315434:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917507584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.315455:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.315479:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917507712:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.315515:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580322.315546:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55fbb80/2, rc 0, transno 8589939113 00000100:00100000:2.0:1777580322.315552:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917505664:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580322.315560:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55f8a80/2, rc 0, transno 8589939116 00000100:00100000:2.0:1777580322.315564:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917505536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.315572:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777580322.315577:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917507840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.315598:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.317271:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3291:x1863919917504640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 80022us (80221us total) trans 8589938713 rc 0/0 00000100:00100000:0.0:1777580322.317286:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12250 00000100:00100000:0.0:1777580322.338650:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917507456 00000100:00100000:0.0:1777580322.338667:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917507456 00000100:00100000:0.0:1777580322.338878:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917507584 00000100:00100000:0.0:1777580322.338882:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917507584 00000100:00100000:0.0:1777580322.338893:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917507712 00000100:00100000:0.0:1777580322.338896:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917507712 00000100:00100000:0.0:1777580322.338905:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917507840 00000100:00100000:0.0:1777580322.338908:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917507840 00000100:00100000:1.0:1777580322.345942:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12260 00000100:00100000:1.0:1777580322.345972:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3288:x1863919917507456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580322.346018:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5584 count 1 00010000:00010000:1.0:1777580322.346070:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.346098:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 16 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.346108:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.346111:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.346115:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.347253:0:205907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12261 00000100:00100000:2.0:1777580322.348621:0:205907:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3288:x1863919917507584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.348678:0:205907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5583 count 1 00010000:00010000:2.0:1777580322.348714:0:205907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.350042:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12262 00000100:00100000:0.0:1777580322.350064:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3290:x1863919917507712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.350161:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5586 count 1 00010000:00010000:0.0:1777580322.350191:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.350214:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 14 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.350223:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.350225:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.350229:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.350273:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 14 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.350287:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 14 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.350302:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917507968:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.352448:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423240 going to sleep for 11 seconds 00010000:00010000:2.0:1777580322.356223:0:205907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 16 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.356249:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.356254:0:205907:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.356260:0:205907:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.356511:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844672 00000100:00100000:2.0:1777580322.356524:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844672 00010000:00010000:2.0:1777580322.360443:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 17 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.360599:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844928 00000100:00100000:2.0:1777580322.360610:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844928 00010000:00010000:2.0:1777580322.360660:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 18 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.360675:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946844800 00000100:00100000:2.0:1777580322.360678:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946844800 00010000:00010000:2.0:1777580322.360696:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 14 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.360911:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4515 00000100:00100000:2.0:1777580322.360926:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2361:x1863919946844672:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.360947:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.360954:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 18 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.360971:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 18 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.361001:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4cf33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ed2f expref: 18 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.361023:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.361025:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.361041:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.361053:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.363884:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.369957:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2361:x1863919946844672:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 9020us (54746us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.369974:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4515 00000100:00100000:2.0:1777580322.370033:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4516 00000100:00100000:2.0:1777580322.370049:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2361:x1863919946844928:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.370070:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.370081:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.370103:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.370150:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.370152:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.370158:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.370170:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.370220:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.379726:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.379761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.379781:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.379902:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.383119:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917508096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.383283:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.383598:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580322.383607:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917508224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.383635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777580322.383672:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.383688:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.383701:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.383820:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.383835:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580322.388285:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508096 00000100:00100000:0.0:1777580322.388299:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508096 00000100:00100000:0.0:1777580322.388587:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508224 00000100:00100000:0.0:1777580322.388609:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508224 00000100:00100000:0.0:1777580322.388637:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12263 00000100:00100000:0.0:1777580322.388649:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3290:x1863919917507840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.388689:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5585 count 1 00000100:00100000:1.0:1777580322.388776:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917506944:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.389291:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.391076:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 14 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.391094:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.391097:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.391102:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.391184:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 14 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.391199:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 14 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.391218:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02484c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917508480:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.391849:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423600 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.392712:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.392813:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917507328:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.392834:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.392863:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 16 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.392877:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.392892:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917509120:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.392947:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738780 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.395568:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580322.395585:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395600:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.395605:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395616:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395672:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395680:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e43a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395710:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580322.395715:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395722:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bc800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.395725:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.395729:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845056 00010000:00010000:1.0:1777580322.395732:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.395748:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845056 00010000:00010000:1.0:1777580322.395751:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395757:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036887a74/0xcb2b2f2f7e4e425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395773:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.395777:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395790:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.395793:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395799:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395807:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395813:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042461f20/0xcb2b2f2f7e4e448 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395824:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.395826:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.395827:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.395836:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 308 pid: 187631 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395853:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580322.395863:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845312 00000100:00100000:1.0:1777580322.395867:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845312 00000100:00100000:0.0:1777580322.395874:0:190365:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845184 00000100:00100000:0.0:1777580322.395877:0:190365:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845184 00010000:00010000:1.0:1777580322.395888:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 16 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.395903:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845440 00000100:00100000:1.0:1777580322.395906:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845440 00010000:00010000:0.0:1777580322.395907:0:190365:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 16 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395919:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 15 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.395923:0:190365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4517 00000100:00100000:0.0:1777580322.395932:0:190365:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023853b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+16:2361:x1863919946844800:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777580322.395945:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4518 00010000:00010000:0.0:1777580322.395948:0:190365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777580322.395951:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+308:2362:x1863919946845056:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.395954:0:190365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 16 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395958:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.395964:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 308 pid: 187631 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.395967:0:190365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 16 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395973:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 308 pid: 187631 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.395985:0:190365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ad164f/0xcb2b2f2f7e4d5bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea9 expref: 16 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.395987:0:187615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580322.395992:0:187615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.395998:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.396000:0:190365:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.396007:0:190365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.396013:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.396017:0:190365:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.396020:0:187615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.396041:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.396112:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+308:2362:x1863919946845056:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 159us (16414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.396120:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4518 00000100:00100000:1.0:1777580322.399011:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4519 00000100:00100000:1.0:1777580322.399046:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2362:x1863919946845312:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.399069:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.399094:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 15 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399113:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 15 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399169:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009453d7de/0xcb2b2f2f7e4d5c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee9b expref: 15 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399718:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.399722:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.399728:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399753:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399794:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.399860:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2362:x1863919946845312:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 831us (20095us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.399869:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4519 00000100:00100000:1.0:1777580322.399916:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4520 00000100:00100000:1.0:1777580322.399926:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2362:x1863919946845184:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.399942:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.399948:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399977:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.399992:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bac91c6/0xcb2b2f2f7e4d362 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee24 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.400002:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.400004:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.400007:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.400013:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.400030:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.400051:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2362:x1863919946845184:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 128us (20269us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.400058:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4520 00000100:00100000:1.0:1777580322.400075:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4521 00000100:00100000:1.0:1777580322.400084:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946845440:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.400092:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.400098:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 15 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.400163:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 15 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.400181:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.401803:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.401812:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.401827:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.401867:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.401932:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946845440:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1844us (22024us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.401943:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4521 00010000:00010000:1.0:1777580322.402003:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.402013:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.402024:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.402031:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.402071:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580322.402992:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+26:3288:x1863919917505152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 128031us (131641us total) trans 8589939117 rc 0/0 00000100:00100000:2.0:1777580322.403003:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12254 00000100:00100000:2.0:1777580322.403035:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12264 00000100:00100000:2.0:1777580322.403051:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:3288:x1863919917508096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580322.403097:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5627 count 1 00010000:00010000:2.0:1777580322.403125:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.403171:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.403179:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.403191:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.403194:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.403235:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.403248:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.403264:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917509248:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.408849:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508480 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.408905:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917508736:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.408988:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580322.409889:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3291:x1863919917507200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 95948us (98415us total) trans 8589939118 rc 0/0 00000100:00100000:1.0:1777580322.409901:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12259 00000100:00100000:1.0:1777580322.409948:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12265 00000100:00100000:1.0:1777580322.409965:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3288:x1863919917508224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.410004:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5625 count 1 00010000:00010000:1.0:1777580322.410034:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410064:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410073:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.410076:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.410079:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410124:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410161:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.410177:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917509376:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.410261:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738840 going to sleep for 11 seconds 00010000:00010000:1.0:1777580322.410289:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410315:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410327:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410337:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.410361:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1777580322.411781:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1c000/2, rc 0, transno 8589939117 00000100:00100000:2.0:1777580322.411817:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.411839:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580322.411849:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1863919917508864:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.411933:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.411986:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508736 00000100:00100000:2.0:1777580322.411995:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508736 00000100:00100000:2.0:1777580322.412044:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508864 00000100:00100000:2.0:1777580322.412047:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508864 00000100:00100000:2.0:1777580322.412080:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1777580322.412090:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917508736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.412170:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917508736:12345-0@lo:400:kworker.0 Request processed in 82us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.412177:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1777580322.412207:0:188495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1777580322.412213:0:188495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1863919917508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.412240:0:188495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1863919917508864:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.412246:0:188495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00080000:2.0:1777580322.412334:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580322.412358:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1863919917508864:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.412371:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917508736:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.412521:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.412651:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.412728:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845568 00000100:00100000:2.0:1777580322.412732:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845568 00010000:00010000:2.0:1777580322.412773:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.412794:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845696 00000100:00100000:2.0:1777580322.412809:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845696 00010000:00010000:2.0:1777580322.412824:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 17 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.412838:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4522 00000100:00100000:2.0:1777580322.412845:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946845568:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.412858:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.412863:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.412876:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 15 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.412910:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.412912:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.412920:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.412930:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.412953:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.412991:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2361:x1863919946845568:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 146us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.412997:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4522 00000100:00100000:2.0:1777580322.413012:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4523 00000100:00100000:2.0:1777580322.413018:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2361:x1863919946845696:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580322.413033:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580322.413037:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 17 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.413047:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 17 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.413061:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.413063:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.413066:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.413074:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.413084:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580322.413100:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2361:x1863919946845696:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.413106:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4523 00000100:00100000:2.0:1777580322.413195:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917508352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.413237:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.413254:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1863919917508992:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413274:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.413297:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1777580322.413303:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3290:1863919917508608:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413331:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.413368:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917509504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.413388:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.413411:0:187625:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508608 00000100:00100000:2.0:1777580322.413415:0:187625:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508608 00000100:00100000:2.0:1777580322.413444:0:187625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1777580322.413451:0:187625:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3290:x1863919917508608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413490:0:187625:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3290:x1863919917508608:12345-0@lo:400:kworker.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.413496:0:187625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1777580322.413529:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508992 00000100:00100000:2.0:1777580322.413533:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508992 00000100:00100000:2.0:1777580322.413566:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1777580322.413571:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3290:x1863919917508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413607:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3290:x1863919917508992:12345-0@lo:400:kworker.0 Request processed in 36us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580322.413613:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00080000:2.0:1777580322.413628:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580322.413658:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3290:1863919917508608:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413669:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1863919917508992:0@lo:400:kworker.0 00000100:00100000:2.0:1777580322.413695:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917508352 00000100:00100000:2.0:1777580322.413698:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917508352 00000100:00100000:2.0:1777580322.413715:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917509504 00000100:00100000:2.0:1777580322.413718:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917509504 00000100:00100000:2.0:1777580322.413728:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12266 00000100:00100000:2.0:1777580322.413734:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3290:x1863919917508352:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580322.413980:0:189456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000893dd74d/0xcb2b2f2f7e4d3b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee2b expref: 14 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.413995:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02484c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917508480:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.414031:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.414042:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.414049:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.414061:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.414069:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.414084:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777580322.414373:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580322.414384:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414395:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.414400:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414411:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414428:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414446:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f36a9d/0xcb2b2f2f7e4e479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414470:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580322.414474:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414481:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea2600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.414484:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414490:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414499:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414505:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005372e813/0xcb2b2f2f7e4e464 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414517:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.414520:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414527:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bde00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.414537:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414558:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414572:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414579:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529414c5/0xcb2b2f2f7e4e495 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414597:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.414599:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.414601:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.414631:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580322.414663:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12267 00000100:00100000:1.0:1777580322.414676:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3290:x1863919917509504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580322.414710:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5626 count 1 00010000:00010000:1.0:1777580322.414736:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414769:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414777:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.414779:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.414793:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414833:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.414848:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.414865:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917509632:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.414962:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.417278:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3290:x1863919917506688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 126221us (126342us total) trans 8589939119 rc 0/0 00000100:00100000:1.0:1777580322.417294:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12258 00010000:00010000:1.0:1777580322.417609:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417623:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417634:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417643:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417679:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.417693:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.417699:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417706:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bd800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.417711:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417720:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417754:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417762:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002173d60/0xcb2b2f2f7e4e3ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.417802:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.417804:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.417806:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1777580322.426975:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5628 count 1 00010000:00010000:2.0:1777580322.427036:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.427067:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.427076:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.427078:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.427082:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.427130:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 11 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.427164:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.427194:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917509760:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.427837:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508900 going to sleep for 11 seconds 00000004:00080000:2.0:1777580322.427904:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55c4000/2, rc 0, transno 8589939119 00000004:00080000:1.0:1777580322.427910:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384fff480/2, rc 0, transno 8589939118 00000100:00100000:2.0:1777580322.427920:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917506688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580322.429342:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917507200:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1777580322.429391:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffe300/2, rc 0, transno 8589938713 00000100:00100000:1.0:1777580322.429410:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917504640:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580322.429485:0:205896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a6b227a/0xcb2b2f2f7e4d186 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edad expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.429506:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917509120:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.429533:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429545:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429553:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429566:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429575:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429598:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.429618:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.429625:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429634:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea3400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.429639:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429657:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429681:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429687:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082cb247c/0xcb2b2f2f7e4e480 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.429713:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.429715:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.429717:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580322.436606:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3290:x1863919917507840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47947us (120992us total) trans 8589938714 rc 0/0 00000100:00100000:0.0:1777580322.436624:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12263 00010000:00010000:0.0:1777580322.439281:0:205898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be878531/0xcb2b2f2f7e4d2dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ee01 expref: 13 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.439622:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3288:x1863919917507456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 93662us (124217us total) trans 8589938716 rc 0/0 00000100:00100000:1.0:1777580322.439636:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12260 00000100:00100000:0.0:1777580322.439831:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917507968:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.439863:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.439877:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.439885:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.439898:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.439906:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.439937:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.439965:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.439973:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.439983:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024975bce00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.439987:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.439998:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.440035:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.440042:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d07a1bf3/0xcb2b2f2f7e4e48e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.440067:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.440069:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.440071:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580322.442303:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3290:x1863919917507712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 92226us (126763us total) trans 8589938717 rc 0/0 00000004:00080000:2.0:1777580322.442934:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b2a00/2, rc 0, transno 8589938716 00000100:00100000:2.0:1777580322.442944:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917507456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.443047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.444684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.444805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.444850:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.444917:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917509248:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.444949:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.444989:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845824 00000100:00100000:2.0:1777580322.444997:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845824 00010000:00010000:2.0:1777580322.445038:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 12 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.445063:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946845952 00000100:00100000:2.0:1777580322.445065:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946845952 00010000:00010000:2.0:1777580322.445078:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.445088:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846080 00000100:00100000:2.0:1777580322.445090:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846080 00010000:00010000:2.0:1777580322.445101:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 14 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.445112:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846208 00000100:00100000:2.0:1777580322.445114:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846208 00010000:00010000:2.0:1777580322.445125:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 15 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.446086:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917509376:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.446118:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.446221:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4524 00000100:00100000:1.0:1777580322.446237:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+15:2362:x1863919946845824:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.446257:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.446266:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 15 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446280:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 15 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446318:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955d224d/0xcb2b2f2f7e4d824 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef35 expref: 15 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446355:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446357:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446362:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446373:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446406:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.446468:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+14:2362:x1863919946845824:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 237us (3421us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.446476:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4524 00000100:00100000:1.0:1777580322.446502:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4525 00000100:00100000:1.0:1777580322.446509:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2362:x1863919946845952:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.446517:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.446523:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446532:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446545:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a8bee1d/0xcb2b2f2f7e4d81d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef4a expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446564:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446566:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446569:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446575:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.446575:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12262 00010000:00010000:1.0:1777580322.446590:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.446610:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2362:x1863919946845952:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 102us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.446616:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4525 00000100:00100000:1.0:1777580322.446629:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4526 00000100:00100000:1.0:1777580322.446635:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2362:x1863919946846080:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.446644:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.446648:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446657:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 11 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446668:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446670:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446673:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446692:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446704:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.446725:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2362:x1863919946846080:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 90us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.446731:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4526 00000100:00100000:1.0:1777580322.446762:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4527 00000100:00100000:1.0:1777580322.446769:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946846208:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.446777:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.446782:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 10 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446792:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 10 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446804:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446805:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.446809:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446817:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446828:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.446854:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946846208:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 86us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.446860:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4527 00010000:00010000:1.0:1777580322.446901:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e1987/0xcb2b2f2f7e4d839 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef58 expref: 9 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.446912:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205897:1863919917509632:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.446927:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446936:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446943:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446954:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446963:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.446986:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580322.447602:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3290:x1863919917509504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32927us (34207us total) trans 8589939120 rc 0/0 00000100:00100000:1.0:1777580322.447612:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12267 00010000:00010000:1.0:1777580322.447815:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.447824:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447835:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.447840:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447852:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447873:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447880:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c692814/0xcb2b2f2f7e4e4aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447901:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.447903:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.447905:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.447918:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447927:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447935:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447950:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.447970:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777580322.448350:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3288:x1863919917508224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38391us (64712us total) trans 8589939121 rc 0/0 00000100:00100000:1.0:1777580322.448358:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12265 00010000:00010000:1.0:1777580322.448387:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.448393:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.448401:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea3200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.448404:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.448410:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.448421:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.448428:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027bdd39b/0xcb2b2f2f7e4e4a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.448446:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.448454:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.448456:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580322.450530:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02390ed3480/2, rc 0, transno 8589939120 00000100:00100000:0.0:1777580322.450561:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917509504:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580322.450582:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b0a80/2, rc 0, transno 8589938714 00000100:00100000:0.0:1777580322.450588:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917507840:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580322.450628:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b3480/2, rc 0, transno 8589938717 00000100:00100000:0.0:1777580322.450632:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917507712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.450843:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+23:3288:x1863919917501312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 279940us (304820us total) trans 8589938715 rc 0/0 00000100:00100000:0.0:1777580322.450856:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12239 00010000:00010000:0.0:1777580322.451175:0:190365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.451238:0:190365:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+8:2361:x1863919946844800:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 55302us (135986us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.451248:0:190365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4517 00010000:00010000:0.0:1777580322.456149:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.456174:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.456189:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.456198:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.456226:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.456500:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.456511:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.456519:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.456526:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.456542:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777580322.457526:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.457569:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.457578:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.457585:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.457596:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580322.457965:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3288:x1863919917508096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54915us (74677us total) trans 8589939122 rc 0/0 00000100:00100000:2.0:1777580322.457977:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12264 00000004:00080000:2.0:1777580322.458057:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1c380/2, rc 0, transno 8589939121 00000100:00100000:2.0:1777580322.458065:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917508224:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580322.458075:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1ca80/2, rc 0, transno 8589939122 00000100:00100000:2.0:1777580322.458078:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917508096:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580322.458094:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095e300/2, rc 0, transno 8589938715 00000100:00100000:2.0:1777580322.458099:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917501312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.458855:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3289:x1863919917504256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 230815us (230992us total) trans 8589938718 rc 0/0 00000100:00100000:0.0:1777580322.458868:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12249 00010000:00010000:0.0:1777580322.458911:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.458939:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.458951:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.458959:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.458970:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1777580322.459883:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917509888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.459956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.461183:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:3291:x1863919917504896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 221381us (221472us total) trans 8589938719 rc 0/0 00000100:00100000:0.0:1777580322.461197:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12251 00010000:00010000:3.0:1777580322.463876:0:205906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3240f1/0xcb2b2f2f7e4d840 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef5f expref: 7 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.463909:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:205906:1863919917509760:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.463945:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.463958:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.463967:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.463981:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.463990:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.464008:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1777580322.467593:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02390ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3290:x1863919917508352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53848us (54344us total) trans 8589939123 rc 0/0 00000100:00100000:3.0:1777580322.467661:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12266 00000100:00100000:2.0:1777580322.468176:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.468227:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.468564:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917509888 00000100:00100000:0.0:1777580322.468576:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917509888 00000100:00100000:3.0:1777580322.468848:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:3.0:1777580322.468859:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3288:x1863919917509888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777580322.468897:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5590 count 1 00010000:00010000:3.0:1777580322.468929:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.468955:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 12 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.468965:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.468967:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777580322.468971:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.469010:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 12 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.469027:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 12 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.469039:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917510528:192.168.202.9@tcp:104: 00000100:00100000:3.0:1777580322.475866:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02484e153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.476048:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3288:x1863919917505920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 197331us (204533us total) trans 8589939124 rc 0/0 00000100:00100000:1.0:1777580322.476060:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12257 00000004:00080000:2.0:1777580322.479653:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aec39880/2, rc 0, transno 8589939124 00000100:00100000:2.0:1777580322.479682:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.480499:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1777580322.480525:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.480667:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.483492:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510400 00000100:00100000:0.0:1777580322.483507:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510400 00000100:00100000:0.0:1777580322.483700:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12269 00000100:00100000:0.0:1777580322.483816:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3288:x1863919917510400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.483861:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5591 count 1 00010000:00010000:0.0:1777580322.483894:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.483923:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 12 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.483959:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.483962:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.483967:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484011:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 12 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484025:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 12 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.484042:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917511040:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.484163:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423600 going to sleep for 11 seconds 00010000:00010000:0.0:1777580322.484187:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1777580322.484196:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484204:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f50e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.484209:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484219:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484241:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484257:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f1ab1e7/0xcb2b2f2f7e4e41e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484288:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580322.484292:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484299:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0249dea3800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.484302:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.484529:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.485689:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.485704:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000717fd3e6/0xcb2b2f2f7e4e45d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777580322.485862:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095d180/2, rc 0, transno 8589938718 00000100:00100000:1.0:1777580322.485886:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917504256:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580322.485942:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580322.485949:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.485958:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.485962:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.485996:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486010:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486017:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efeb0cec/0xcb2b2f2f7e4e49c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486039:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580322.486045:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486052:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.486055:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486062:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486072:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486079:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb88ba4c/0xcb2b2f2f7e4e42c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486106:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.486110:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486117:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.486120:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486127:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486417:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486425:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074bfda30/0xcb2b2f2f7e4e4b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486440:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.486441:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.486443:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.486451:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.486526:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.486529:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.486531:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.486644:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024c62d9600/0xcb2b2f2f7dc8bc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf8ec976 expref: 307 pid: 187631 timeout: 7943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.486662:0:187631:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:187631:1863919917507072:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580322.486710:0:187631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486722:0:187631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.486729:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487081:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.487879:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d5e4932/0xcb2b2f2f7e4d17f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90edb4 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.487915:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917506432:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.487937:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487948:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487954:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487964:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487972:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.487995:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00200000:1.0:1777580322.491066:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00010000:00010000:1.0:1777580322.491099:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.491112:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.491121:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.491128:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838200 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580322.491171:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493579:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493627:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffffa02490544300) 00010000:00010000:1.0:1777580322.493631:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777580322.493641:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493649:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838200/0xcb2b2f2f7e4e472 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493734:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493751:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493759:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493765:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02383f51000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:1.0:1777580322.493770:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493777:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493786:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024ae57bf00) 00010000:00010000:1.0:1777580322.493789:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777580322.493793:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.493799:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02383f51000/0xcb2b2f2f7e4e433 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777580322.493819:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000052b5e68d reply state 00000000b2bac862 transno 8589951170 ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.493831:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777580322.493985:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+32:283583:x1863919946843648:12345-192.168.202.9@tcp:36:rm.0 Request processed in 227934us (233345us total) trans 8589951170 rc 0/0 00000100:00100000:1.0:1777580322.493997:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 879 00010000:00010000:1.0:1777580322.494074:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.494084:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.494093:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.494097:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.494106:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.494124:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.494132:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff1bd27d/0xcb2b2f2f7e4e44f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.496701:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3288:x1863919917505792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 219434us (225284us total) trans 8589939125 rc 0/0 00000100:00100000:0.0:1777580322.497518:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12255 00010000:00010000:1.0:1777580322.499569:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.499576:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.499579:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.499657:0:205907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 15 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.499681:0:205907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.499700:0:205907:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917511168:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580322.499834:0:205907:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393738840 going to sleep for 11 seconds 00000100:00100000:1.0:1777580322.499982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580322.500018:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846336 00000100:00100000:1.0:1777580322.500026:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846336 00010000:00010000:1.0:1777580322.500065:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.500101:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4528 00000100:00100000:1.0:1777580322.500113:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2361:x1863919946846336:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.500125:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.500131:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.500170:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.500214:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.500217:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.500223:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.500235:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.500255:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.500283:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2361:x1863919946846336:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.500303:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4528 00010000:00010000:0.0:1777580322.500512:0:206023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b59116/0xcb2b2f2f7e4d832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef3c expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.500530:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917511040:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.500646:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.500657:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.500665:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.500676:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.500685:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.500888:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.501607:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580322.501619:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.501630:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580322.501635:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.501647:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.501668:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.501675:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e4bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.501703:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.501705:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580322.501706:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580322.504072:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.504167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580322.504226:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024aec3b480/2, rc 0, transno 8589939125 00000100:00100000:2.0:1777580322.504232:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024aec3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917505792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.504270:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.504336:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.504360:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.504381:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777580322.504409:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384fff800/2, rc 0, transno 8589938719 00000100:00100000:2.0:1777580322.504416:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917504896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.504432:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777580322.504439:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02390ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.504460:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.504480:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.504500:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.504532:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510016 00000100:00100000:2.0:1777580322.504547:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510016 00000100:00100000:2.0:1777580322.504606:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510656 00000100:00100000:2.0:1777580322.504608:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510656 00000100:00100000:2.0:1777580322.504628:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510272 00000100:00100000:2.0:1777580322.504631:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510272 00000100:00100000:2.0:1777580322.504676:0:189456:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510912 00000100:00100000:2.0:1777580322.504680:0:189456:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510912 00000100:00100000:2.0:1777580322.504697:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12270 00000100:00100000:2.0:1777580322.504707:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3288:x1863919917510016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.504758:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5587 count 1 00010000:00010000:2.0:1777580322.504791:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.504821:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 11 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.504831:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.504833:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.504837:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.504877:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 11 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.504891:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 11 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.504904:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917511296:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.504968:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024905083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.504987:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510144 00000100:00100000:2.0:1777580322.504990:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510144 00000100:00100000:2.0:1777580322.505015:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917510784 00000100:00100000:2.0:1777580322.505018:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917510784 00000100:00100000:2.0:1777580322.505047:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12271 00000100:00100000:2.0:1777580322.505053:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917510656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580322.505068:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5629 count 1 00010000:00010000:2.0:1777580322.505086:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505098:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 6 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505104:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505106:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505108:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505128:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 6 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505185:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 6 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.505197:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917511424:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.505228:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024905089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.505374:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12272 00000100:00100000:2.0:1777580322.505383:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3291:x1863919917510272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.505395:0:205898:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5589 count 1 00010000:00010000:2.0:1777580322.505409:0:205898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505430:0:205898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 11 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505438:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505439:0:205898:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505441:0:205898:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505461:0:205898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 11 pid: 205908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505471:0:205898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 11 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.505482:0:205898:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917511552:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.505512:0:205898:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508540 going to sleep for 11 seconds 00000004:00080000:2.0:1777580322.505606:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1f480/2, rc 0, transno 8589939123 00000100:00100000:2.0:1777580322.505613:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917508352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580322.505635:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12273 00000100:00100000:2.0:1777580322.505643:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3291:x1863919917510912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580322.505657:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5631 count 1 00010000:00010000:2.0:1777580322.505668:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505693:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505699:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505701:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505703:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505725:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505735:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.505759:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02496e80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917511936:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.505784:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508240 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.505804:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12274 00000100:00100000:2.0:1777580322.505812:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3291:x1863919917510144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.505824:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5588 count 1 00010000:00010000:2.0:1777580322.505837:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505849:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 11 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505868:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505870:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.505873:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505894:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 11 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.505911:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 11 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.505922:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02496e81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917512064:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.505946:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508180 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.505965:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12275 00000100:00100000:2.0:1777580322.505973:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3291:x1863919917510784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580322.505985:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5630 count 1 00010000:00010000:2.0:1777580322.505997:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506009:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506017:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506018:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506028:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506047:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506056:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.506067:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0248626aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917512192:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.506089:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508480 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.506106:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917511680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.506185:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580322.506222:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777580322.506228:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0249c30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917511808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.506247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777580322.506319:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580322.506331:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917511680 00000100:00100000:2.0:1777580322.506337:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917511680 00000100:00100000:2.0:1777580322.506368:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917511808 00000100:00100000:2.0:1777580322.506370:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917511808 00000100:00100000:2.0:1777580322.506387:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12276 00000100:00100000:2.0:1777580322.506393:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+29:3288:x1863919917511680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.506404:0:206020:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5594 count 1 00010000:00010000:2.0:1777580322.506419:0:206020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506446:0:206020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 11 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506452:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506453:0:206020:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506456:0:206020:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506476:0:206020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 11 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506486:0:206020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 11 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.506497:0:206020:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0248626a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917512320:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.506532:0:206020:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02490508900 going to sleep for 11 seconds 00000100:00100000:2.0:1777580322.506551:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12277 00000100:00100000:2.0:1777580322.506558:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+29:3288:x1863919917511808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580322.506571:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5592 count 1 00010000:00010000:2.0:1777580322.506585:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506598:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 11 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506620:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506622:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580322.506625:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506650:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 11 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.506661:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 11 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.506672:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917512448:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580322.506698:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa024b6290c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777580322.507326:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917510400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23515us (39096us total) trans 8589938720 rc 0/0 00000100:00100000:0.0:1777580322.507336:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12269 00000100:00100000:0.0:1777580322.508714:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2361:x1863919946844928:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 138661us (193477us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.508730:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4516 00000100:00100000:3.0:1777580322.521058:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917510528:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.521098:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.521352:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.521451:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.521478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.521532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580322.521631:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846464 00000100:00100000:1.0:1777580322.521639:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846464 00010000:00010000:1.0:1777580322.521681:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 12 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.521711:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846592 00000100:00100000:1.0:1777580322.521720:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846592 00010000:00010000:1.0:1777580322.521746:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.521767:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846720 00000100:00100000:1.0:1777580322.521770:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846720 00010000:00010000:1.0:1777580322.521784:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 13 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.521794:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846848 00000100:00100000:1.0:1777580322.521797:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846848 00010000:00010000:1.0:1777580322.521809:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 7 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.521823:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4529 00000100:00100000:1.0:1777580322.521832:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+13:2362:x1863919946846464:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.521850:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580322.521856:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.521870:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.521897:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000251b8397/0xcb2b2f2f7e4d82b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef51 expref: 13 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.521913:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.521922:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.521928:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.521939:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.521964:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.521972:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.521976:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580322.521978:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.521983:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838600 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580322.521987:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.521993:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522003:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac38cf7d (ffffa02497a21b00) 00010000:00010000:0.0:1777580322.522006:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580322.522009:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522014:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02484838600/0xcb2b2f2f7e4e46b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.522038:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2362:x1863919946846464:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 204us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.522048:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4529 00000100:00100000:1.0:1777580322.522071:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4530 00010000:00010000:3.0:1777580322.522078:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.522078:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2363:x1863919946846592:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.522086:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777580322.522087:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522091:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.522097:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522102:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 16 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.522105:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.522112:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4531 00010000:00010000:1.0:1777580322.522118:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.522120:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1777580322.522123:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2363:x1863919946846720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.522125:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.522130:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.522159:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522176:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.522183:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 11 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522203:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 11 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522208:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777580322.522215:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.522217:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.522220:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522225:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522238:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.522240:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2363:x1863919946846592:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 161us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.522249:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4530 00000100:00100000:0.0:1777580322.522263:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023e64dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2363:x1863919946846720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 143us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.522270:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4531 00000100:00100000:0.0:1777580322.522286:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4532 00000100:00100000:0.0:1777580322.522292:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+7:2361:x1863919946846848:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.522301:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.522304:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 7 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522315:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 7 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522330:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.522340:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.522342:0:205907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099b045f/0xcb2b2f2f7e4d178 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eda6 expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522345:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522365:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.522368:0:205907:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:205907:1863919917511168:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.522387:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580322.522393:0:205907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522405:0:205907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.522405:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+7:2361:x1863919946846848:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 113us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.522418:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4532 00010000:00010000:1.0:1777580322.522425:0:205907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522434:0:205907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522438:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.522444:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522446:0:205907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522463:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.522468:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.522473:0:205907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580322.522478:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522492:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522499:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9618784/0xcb2b2f2f7e4e4b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522535:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1777580322.522830:0:205907:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023853b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917507584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175564us (207372us total) trans 8589938721 rc 0/0 00000100:00100000:1.0:1777580322.522840:0:205907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12261 00010000:00010000:1.0:1777580322.522866:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.522910:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522917:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.522919:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522924:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522931:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522935:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffe32580/0xcb2b2f2f7e4e487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.522949:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.522950:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.522951:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580322.523531:0:189456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7fc97f3/0xcb2b2f2f7e4d5b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eea2 expref: 10 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.523548:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917511296:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.523569:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.523578:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.523586:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.523608:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.523616:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.523644:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580322.524100:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917510016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19392us (43432us total) trans 8589938722 rc 0/0 00000100:00100000:2.0:1777580322.524108:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12270 00010000:00010000:2.0:1777580322.524181:0:206018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4d96d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef97 expref: 6 pid: 205898 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.524195:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:206018:1863919917511424:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.524210:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.524218:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.524226:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.524234:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.524251:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.524268:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580322.524442:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.524448:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524455:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838a00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.524468:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524477:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524497:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524505:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5bc3595/0xcb2b2f2f7e4e4c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524528:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.524532:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524618:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.524621:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524628:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524638:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524643:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d442402e/0xcb2b2f2f7e4e4cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.524673:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.524676:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.524678:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580322.524716:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+31:3288:x1863919917510656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19662us (20547us total) trans 8589939126 rc 0/0 00000100:00100000:2.0:1777580322.524723:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12271 00000100:00100000:2.0:1777580322.524782:0:205898:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:205898:1863919917511552:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.524795:0:205898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.524823:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02496e80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:205895:1863919917511936:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.524835:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777580322.524870:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02390ed1c00/2, rc 0, transno 8589938722 00010000:00010000:1.0:1777580322.525505:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580322.525666:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3288:x1863919917509888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56807us (65707us total) trans 8589938723 rc 0/0 00000100:00100000:3.0:1777580322.525675:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:2.0:1777580322.527817:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510016:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580322.527883:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e4700/2, rc 0, transno 8589939126 00000100:00100000:2.0:1777580322.527898:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510656:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1777580322.527913:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02390ed3800/2, rc 0, transno 8589938723 00000100:00100000:2.0:1777580322.527917:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917509888:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580322.527927:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024b55c2300/2, rc 0, transno 8589938720 00000100:00100000:2.0:1777580322.527930:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b55c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917510400:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580322.527971:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b1180/2, rc 0, transno 8589938721 00000100:00100000:2.0:1777580322.527975:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917507584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.528083:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917512704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.528159:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.528192:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580322.528196:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917512576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580322.528209:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580322.528233:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917512704 00000100:00100000:0.0:1777580322.528239:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917512704 00000100:00100000:0.0:1777580322.528274:0:206021:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917512576 00000100:00100000:0.0:1777580322.528276:0:206021:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917512576 00000100:00100000:0.0:1777580322.528289:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12278 00000100:00100000:0.0:1777580322.528295:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917512704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.528331:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5595 count 1 00010000:00010000:0.0:1777580322.528364:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528389:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 14 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528396:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.528398:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.528401:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528436:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 14 pid: 206021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528446:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 14 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.528456:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917512832:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.528520:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777580322.528538:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12279 00000100:00100000:0.0:1777580322.528631:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917512576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1777580322.528643:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5593 count 1 00010000:00010000:0.0:1777580322.528653:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528662:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 9 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528667:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.528668:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.528669:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528691:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 9 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.528807:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 9 pid: 188246 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.528820:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917512960:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580322.528844:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777580322.538692:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.538792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580322.538792:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02496e81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917512064:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.538833:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.540976:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580322.540999:0:187615:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847232 00000100:00100000:1.0:1777580322.541010:0:187615:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847232 00010000:00010000:1.0:1777580322.541064:0:187615:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 10 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.541112:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847104 00000100:00100000:0.0:1777580322.541118:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847104 00000100:00100000:1.0:1777580322.541122:0:187615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4533 00010000:00010000:0.0:1777580322.541158:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580322.541161:0:187615:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946847232:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777580322.541185:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4534 00010000:00010000:1.0:1777580322.541186:0:187615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777580322.541192:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2362:x1863919946847104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580322.541196:0:187615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 10 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541202:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.541208:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.541220:0:187615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 10 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541220:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541255:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb7e0d20/0xcb2b2f2f7e4dd4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f093 expref: 15 pid: 206020 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.541256:0:187615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69acffe/0xcb2b2f2f7e4d5ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb0 expref: 10 pid: 205897 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541280:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.541298:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.541303:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541314:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541346:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.541398:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2362:x1863919946847104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 206us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.541403:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4534 00010000:00010000:0.0:1777580322.541428:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541435:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541443:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541448:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.541462:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777580322.541975:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.541978:0:187615:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580322.541985:0:187615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.542010:0:187615:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580322.542041:0:187615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580322.542086:0:187615:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e34df675-1aa3-4a1f-9c3e-2f402307d398+9:2362:x1863919946847232:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 953us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580322.542095:0:187615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4533 00000100:00100000:0.0:1777580322.544011:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917510912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38361us (39621us total) trans 8589939127 rc 0/0 00000100:00100000:0.0:1777580322.544024:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12273 00000004:00080000:0.0:1777580322.544114:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e4380/2, rc 0, transno 8589939127 00000100:00100000:0.0:1777580322.544130:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580322.544168:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.544176:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.544186:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.544191:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.544199:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.544218:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.544222:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1d006ce/0xcb2b2f2f7e4e4db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.544241:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.544242:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.544243:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580322.545526:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.545642:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.545657:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.545669:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.545837:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580322.546486:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917510144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40669us (42018us total) trans 8589938724 rc 0/0 00000100:00100000:2.0:1777580322.546499:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12274 00000004:00080000:0.0:1777580322.546931:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02390ed3100/2, rc 0, transno 8589938724 00000100:00100000:0.0:1777580322.546945:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510144:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580322.546977:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.546985:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.547017:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.547022:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.547033:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.547054:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.547063:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e4e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.547084:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.547086:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.547088:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580322.547836:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.547874:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.547962:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580322.548001:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.550042:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:206021:1863919917512832:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.550081:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.550121:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:206023:1863919917512960:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580322.550165:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.556802:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580322.559886:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946846976 00000100:00100000:0.0:1777580322.559904:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946846976 00010000:00010000:0.0:1777580322.559964:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 9 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.559998:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847488 00000100:00100000:0.0:1777580322.560001:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847488 00010000:00010000:0.0:1777580322.560016:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 10 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.560028:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847360 00000100:00100000:0.0:1777580322.560030:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847360 00010000:00010000:0.0:1777580322.560042:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 11 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.560054:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847744 00000100:00100000:0.0:1777580322.560057:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847744 00010000:00010000:0.0:1777580322.560068:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 12 pid: 188246 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.560078:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847616 00000100:00100000:0.0:1777580322.560081:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847616 00010000:00010000:0.0:1777580322.560094:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.560105:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946847872 00000100:00100000:0.0:1777580322.560126:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946847872 00010000:00010000:0.0:1777580322.560166:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.560184:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4535 00000100:00100000:0.0:1777580322.560194:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+12:2363:x1863919946846976:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.560216:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.560222:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 12 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560236:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 12 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560263:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4d5d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90eeb7 expref: 12 pid: 205908 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560282:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560284:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560289:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560301:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560339:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.560400:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+11:2363:x1863919946846976:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 207us (19436us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.560418:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4535 00000100:00100000:0.0:1777580322.560441:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4536 00000100:00100000:0.0:1777580322.560447:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946847488:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.560455:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.560460:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 10 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560470:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 10 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560484:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560485:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560489:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560497:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560510:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.560529:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+10:2362:x1863919946847488:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 82us (12703us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.560535:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4536 00000100:00100000:0.0:1777580322.560562:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4537 00000100:00100000:0.0:1777580322.560569:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+9:2362:x1863919946847360:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.560577:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.560588:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 9 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560597:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 9 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560610:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560612:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.560615:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560622:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.560632:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.560652:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+9:2362:x1863919946847360:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 84us (12781us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.560658:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4537 00000100:00100000:0.0:1777580322.561095:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4538 00000100:00100000:0.0:1777580322.561105:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+8:2363:x1863919946847744:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.561114:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.561119:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 8 pid: 188246 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561129:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 8 pid: 188246 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561188:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630528ff/0xcb2b2f2f7e4d989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efb3 expref: 8 pid: 188246 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561201:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561203:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561206:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561214:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561237:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.561263:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+7:2363:x1863919946847744:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 160us (13304us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.561269:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4538 00000100:00100000:0.0:1777580322.561285:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4539 00000100:00100000:0.0:1777580322.561292:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2363:x1863919946847616:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.561303:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.561308:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561316:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561342:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031ece101/0xcb2b2f2f7e4dd41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f07e expref: 15 pid: 206021 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561353:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561354:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561357:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561364:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561381:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.561400:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2363:x1863919946847616:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 109us (13401us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.561406:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4539 00000100:00100000:0.0:1777580322.561418:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4540 00000100:00100000:0.0:1777580322.561426:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+6:2361:x1863919946847872:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580322.561436:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580322.561441:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561452:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 6 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561478:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561479:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580322.561483:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561490:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.561502:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580322.561521:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+6:2361:x1863919946847872:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 96us (4733us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580322.561528:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4540 00010000:00010000:0.0:1777580322.563524:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.563557:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.563570:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.563578:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.563612:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580322.564453:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917512576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35817us (36235us total) trans 8589938725 rc 0/0 00000100:00100000:0.0:1777580322.564467:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12279 00010000:00010000:0.0:1777580322.564520:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.564533:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565113:0:188247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e1e08b/0xcb2b2f2f7e4d982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efa5 expref: 5 pid: 188248 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.565167:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0248626aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:188247:1863919917512192:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.565194:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565204:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565210:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565218:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565224:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.565246:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580322.565670:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.565678:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.565963:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1777580322.566338:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02388b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917512704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38038us (38174us total) trans 8589938726 rc 0/0 00000100:00100000:0.0:1777580322.566349:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12278 00010000:00010000:0.0:1777580322.566388:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580322.566396:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566405:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.566409:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566436:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566458:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566466:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c601c67/0xcb2b2f2f7e4e505 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566489:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580322.566493:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566500:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.566503:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566510:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566520:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.566526:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e4e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580322.566884:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3291:x1863919917510784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60910us (62381us total) trans 8589939128 rc 0/0 00000100:00100000:2.0:1777580322.566893:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12275 00010000:00010000:2.0:1777580322.566919:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580322.566926:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.571034:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.571037:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.571040:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580322.571109:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1f800/2, rc 0, transno 8589938725 00000100:00100000:0.0:1777580322.571152:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917512576:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580322.571170:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1ea00/2, rc 0, transno 8589938726 00000100:00100000:0.0:1777580322.571174:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917512704:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580322.571195:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023871e7800/2, rc 0, transno 8589939128 00000100:00100000:0.0:1777580322.571206:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777580322.571235:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.571252:0:205898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.571265:0:205898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.571277:0:205898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.571286:0:205898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.571310:0:205898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580322.572583:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580322.572590:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572600:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572625:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572633:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e4fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572662:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580322.572667:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572673:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580322.572676:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.572694:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580322.573369:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3291:x1863919917510272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 67982us (69026us total) trans 8589938727 rc 0/0 00000100:00100000:0.0:1777580322.573391:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12272 00000004:00080000:0.0:1777580322.573459:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02390ed1180/2, rc 0, transno 8589938727 00000100:00100000:0.0:1777580322.573474:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02390ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917510272:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580322.573502:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777580322.573658:0:206020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011b3c5e3/0xcb2b2f2f7e4d97b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90efac expref: 6 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777580322.573686:0:206020:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0248626a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:206020:1863919917512320:192.168.202.9@tcp:104: 00010000:00010000:3.0:1777580322.573710:0:206020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.573722:0:206020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.573729:0:206020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.573754:0:206020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.573763:0:206020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580322.573786:0:206020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777580322.573981:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574001:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000992ee59a/0xcb2b2f2f7e4e4d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574027:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580322.574031:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574038:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580322.574042:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574051:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574068:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574078:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e4f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574093:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580322.574096:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580322.574099:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580322.574110:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:3288:x1863919917511680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 67714us (67922us total) trans 8589938728 rc 0/0 00000100:00100000:3.0:1777580322.574119:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12276 00010000:00010000:2.0:1777580322.574167:0:205908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022eaf4ca/0xcb2b2f2f7e4d974 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90ef9e expref: 5 pid: 207637 timeout: 7943 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777580322.574182:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249c30f800/2, rc 0, transno 8589938728 00000100:00100000:3.0:1777580322.574195:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917511680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580322.574200:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:205908:1863919917512448:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580322.574224:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574233:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574240:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574249:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574256:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580322.574269:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777580322.574608:0:187619:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580322.574615:0:187619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.574623:0:187619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0248c032800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580322.574627:0:187619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.574634:0:187619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.574647:0:187619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.574655:0:187619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e239e5ca/0xcb2b2f2f7e4e4f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580322.574671:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.574673:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.574675:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580322.574692:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580322.575262:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+32:3288:x1863919917511808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 68701us (69009us total) trans 8589938729 rc 0/0 00000100:00100000:2.0:1777580322.575272:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12277 00000004:00080000:3.0:1777580322.576797:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0249c30f480/2, rc 0, transno 8589938729 00000100:00100000:3.0:1777580322.576821:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0249c30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917511808:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1777580323.374470:0:187655:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7844323332573ns, next at 7845323328959ns, rc = 0 00000100:00100000:2.0:1777580323.374524:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513088:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1777580323.375367:0:187653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7844324231064ns, next at 7845324229526ns, rc = 0 00000100:00100000:1.0:1777580323.379771:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917513216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777580323.383048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580323.383232:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513088 00000100:00100000:2.0:1777580323.383242:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513088 00000100:00100000:2.0:1777580323.383316:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1777580323.383327:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580323.383330:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3288:x1863919917513088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777580323.383381:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3819962368 avail 3817865216 00000100:00100000:1.0:1777580323.383396:0:192556:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513216 00000100:00100000:1.0:1777580323.383400:0:192556:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513216 00000100:00100000:1.0:1777580323.383424:0:192556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1777580323.383431:0:192556:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+31:3289:x1863919917513216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777580323.383459:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3288:x1863919917513088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580323.383467:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00002000:00000024:1.0:1777580323.383469:0:192556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3845128192 avail 3843031040 00000100:00100000:1.0:1777580323.383514:0:192556:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+31:3289:x1863919917513216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580323.383520:0:192556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1777580323.383547:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777580323.383557:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917513216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1777580323.565045:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580324.589127:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580325.611460:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777580326.155186:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938727 is committed 00000001:00080000:3.0:1777580326.155263:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938729 is committed 00000001:00080000:0.0:1777580326.223419:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939127 is committed 00000001:00080000:0.0:1777580326.223515:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939128 is committed 00010000:00010000:1.0:1777580326.647003:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580327.083530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.083563:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.083583:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.083608:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.083624:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580327.084251:0:206352:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848256 00000100:00100000:0.0:1777580327.084262:0:206352:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848256 00000100:00100000:1.0:1777580327.087218:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848768 00000100:00100000:1.0:1777580327.087235:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848768 00000100:00100000:0.0:1777580327.097827:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 336 00000100:00100000:0.0:1777580327.097852:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2364:x1863919946848256:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580327.098176:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2364:x1863919946848256:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 336us (14610us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580327.098185:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 336 00000100:00100000:1.0:1777580327.098520:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 337 00000100:00100000:1.0:1777580327.098531:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2364:x1863919946848768:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580327.098609:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2364:x1863919946848768:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 81us (15000us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580327.098617:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 337 00000100:00100000:3.0:1777580327.109370:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.109424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580327.109459:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848000 00000100:00100000:3.0:1777580327.109483:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848000 00000100:00100000:0.0:1777580327.109532:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848384 00000100:00100000:0.0:1777580327.109536:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848384 00000100:00100000:3.0:1777580327.109538:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 427 00000100:00100000:3.0:1777580327.109547:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946848000:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580327.109562:0:188248:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848640 00000100:00100000:0.0:1777580327.109565:0:188248:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848640 00000100:00100000:0.0:1777580327.109589:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 338 00000100:00100000:0.0:1777580327.109595:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2364:x1863919946848384:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580327.109630:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2364:x1863919946848000:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 84us (26110us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580327.109638:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 427 00000100:00100000:0.0:1777580327.109645:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2364:x1863919946848384:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580327.109651:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 338 00000100:00100000:0.0:1777580327.109661:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 339 00000100:00100000:0.0:1777580327.109676:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2364:x1863919946848640:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1777580327.109726:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2364:x1863919946848640:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 50us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580327.109731:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 339 00000100:00080000:0.0:1777580327.111103:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777580327.111110:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1777580327.115167:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951169 is committed 00000004:00080000:1.0:1777580327.115185:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 220 committed 00000001:00080000:1.0:1777580327.115200:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951170 is committed 00000004:00080000:1.0:1777580327.115217:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 213 committed 00000100:00100000:1.0:1777580327.115446:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513344:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115524:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115584:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115606:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115632:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1777580327.115638:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115658:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115689:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115720:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115749:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115772:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115796:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917514112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115820:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115837:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1777580327.115842:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115862:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115879:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917514240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.115896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.115955:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513344 00000100:00100000:1.0:1777580327.115964:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513344 00000100:00100000:1.0:1777580327.116028:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513856 00000100:00100000:1.0:1777580327.116031:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513856 00000100:00100000:1.0:1777580327.116047:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513472 00000100:00100000:1.0:1777580327.116049:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513472 00000100:00100000:1.0:1777580327.116063:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513984 00000100:00100000:1.0:1777580327.116065:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513984 00000100:00100000:1.0:1777580327.116078:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513600 00000100:00100000:1.0:1777580327.116080:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513600 00000100:00100000:1.0:1777580327.116095:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514112 00000100:00100000:1.0:1777580327.116097:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514112 00000100:00100000:1.0:1777580327.116114:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917513728 00000100:00100000:1.0:1777580327.116116:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917513728 00000100:00100000:1.0:1777580327.116131:0:206018:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514240 00000100:00100000:1.0:1777580327.116181:0:206018:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514240 00000100:00100000:1.0:1777580327.116207:0:206018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12280 00000100:00100000:1.0:1777580327.116215:0:206018:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917513344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580327.116244:0:206018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5596 count 1 00000100:00100000:2.0:1777580327.123004:0:188495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848512 00000100:00100000:2.0:1777580327.123026:0:188495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848512 00010000:00010000:1.0:1777580327.127123:0:206018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127174:0:206018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 13 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127184:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.127187:0:206018:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.127191:0:206018:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127253:0:206018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 13 pid: 188246 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127370:0:206018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 13 pid: 188246 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.127388:0:206018:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917515392:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.127493:0:206018:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239ff9da80 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.127535:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12281 00000100:00100000:1.0:1777580327.127554:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917513856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580327.127590:0:205906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5599 count 1 00010000:00010000:1.0:1777580327.127614:0:205906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127626:0:205906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127632:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.127633:0:205906:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.127635:0:205906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127652:0:205906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.127660:0:205906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 13 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.127987:0:205906:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917515520:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.128016:0:205906:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239ff9d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.128035:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12282 00000100:00100000:1.0:1777580327.128044:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917513472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580327.128058:0:207637:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5597 count 1 00010000:00010000:1.0:1777580327.128071:0:207637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128084:0:207637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 13 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128090:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128092:0:207637:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128094:0:207637:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128112:0:207637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 13 pid: 206020 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128123:0:207637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 13 pid: 206020 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.128155:0:207637:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917515648:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.128181:0:207637:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239ff9df00 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.128207:0:205896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12283 00000100:00100000:1.0:1777580327.128214:0:205896:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3290:x1863919917513984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580327.128232:0:205896:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5601 count 1 00000100:00100000:2.0:1777580327.128235:0:188247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12284 00010000:00010000:1.0:1777580327.128243:0:205896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.128244:0:188247:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917513600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580327.128255:0:205896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1777580327.128256:0:188247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5598 count 1 00010000:00010000:1.0:1777580327.128262:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128264:0:205896:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128266:0:205896:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128267:0:188247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128278:0:188247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 13 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128285:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.128286:0:188247:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.128289:0:188247:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128309:0:188247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 13 pid: 207637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128331:0:188247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 13 pid: 207637 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.128341:0:188247:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917515776:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580327.128373:0:188247:0:(client.c:2691:ptlrpc_set_wait()) set ffffa023922003c0 going to sleep for 11 seconds 00010000:00010000:1.0:1777580327.128376:0:205896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128386:0:205896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 13 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.128390:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12285 00000100:00100000:2.0:1777580327.128397:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aced0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917514112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777580327.128397:0:205896:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917515904:192.168.202.9@tcp:104: 00002000:00080000:2.0:1777580327.128410:0:189456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5600 count 1 00000100:00100000:1.0:1777580327.128420:0:205896:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239ff9d9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1777580327.128422:0:189456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128434:0:189456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 13 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.128437:0:205895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12286 00010000:00010000:2.0:1777580327.128441:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.128443:0:189456:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777580327.128444:0:205895:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917513728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580327.128445:0:189456:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1777580327.128457:0:205895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5602 count 1 00010000:00010000:1.0:1777580327.128468:0:205895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128484:0:205895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128490:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128492:0:205895:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128494:0:205895:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128513:0:205895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128522:0:205895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 13 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.128531:0:205895:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917516160:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.128555:0:205895:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02498a52540 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.128575:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12287 00000100:00100000:1.0:1777580327.128584:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3288:x1863919917514240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777580327.128596:0:205897:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5604 count 1 00010000:00010000:1.0:1777580327.128607:0:205897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128620:0:205897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128640:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128641:0:205897:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.128644:0:205897:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.128662:0:205897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128710:0:189456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 13 pid: 206352 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.128721:0:189456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 13 pid: 206352 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.128743:0:189456:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917516032:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580327.128769:0:189456:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02392200cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777580327.129166:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848128 00000100:00100000:2.0:1777580327.129174:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848128 00000100:00100000:2.0:1777580327.129245:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 507 00000100:00100000:2.0:1777580327.129253:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2364:x1863919946848128:12345-192.168.202.9@tcp:400:kworker.0 00010000:00010000:1.0:1777580327.129994:0:205897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 13 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.130008:0:205897:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917516288:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.130068:0:205897:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393f85840 going to sleep for 11 seconds 00000100:00080000:1.0:1777580327.130097:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777580327.130103:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777580327.130163:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580327.130170:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2364:x1863919946848128:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 918us (46544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.130178:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 507 00000100:00100000:1.0:1777580327.130208:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.130242:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917515008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.130260:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580327.130336:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 508 00000100:00100000:2.0:1777580327.130345:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2364:x1863919946848512:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1777580327.130380:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2364:x1863919946848512:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 37us (46796us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.130386:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 508 00000100:00100000:1.0:1777580327.130882:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1777580327.130891:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.130920:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.130942:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.130960:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.131000:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514496 00000100:00100000:1.0:1777580327.131007:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514496 00000100:00100000:1.0:1777580327.131035:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917515008 00000100:00100000:1.0:1777580327.131038:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917515008 00000100:00100000:1.0:1777580327.131051:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514368 00000100:00100000:1.0:1777580327.131053:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514368 00000100:00100000:1.0:1777580327.131066:0:188246:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514880 00000100:00100000:1.0:1777580327.131068:0:188246:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514880 00000100:00100000:1.0:1777580327.131082:0:188246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12288 00000100:00100000:1.0:1777580327.131089:0:188246:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3291:x1863919917514496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580327.131112:0:188246:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5633 count 1 00010000:00010000:1.0:1777580327.131164:0:188246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.131185:0:188246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 13 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.131194:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.131196:0:188246:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.131199:0:188246:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.131230:0:188246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 13 pid: 188247 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.131241:0:188246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 13 pid: 188247 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.131252:0:188246:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917516416:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580327.132053:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12289 00000100:00100000:0.0:1777580327.132068:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3291:x1863919917515008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580327.132087:0:188248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5635 count 1 00010000:00010000:0.0:1777580327.132105:0:188248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.132122:0:188248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 13 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.132129:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.132131:0:188248:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.132148:0:188248:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.132176:0:188248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 13 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.132187:0:188248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 13 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.132197:0:188248:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917516544:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.132298:0:188246:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393f85f00 going to sleep for 11 seconds 00000100:00080000:1.0:1777580327.132314:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777580327.132319:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777580327.132332:0:205908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12290 00000100:00100000:1.0:1777580327.132340:0:205908:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3291:x1863919917514368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580327.132352:0:205908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5632 count 1 00010000:00010000:1.0:1777580327.132365:0:205908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.132376:0:205908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.132382:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.132383:0:205908:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.132386:0:205908:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.132402:0:205908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 13 pid: 205897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.132410:0:205908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 13 pid: 205897 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.132420:0:205908:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917516672:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580327.137738:0:188248:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423240 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.140808:0:205908:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393f85780 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.140859:0:206023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12291 00000100:00100000:1.0:1777580327.140881:0:206023:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3291:x1863919917514880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580327.140937:0:206023:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5638 count 1 00010000:00010000:1.0:1777580327.140970:0:206023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.140995:0:206023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 13 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.141004:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.141006:0:206023:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.141010:0:206023:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.141473:0:206023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 13 pid: 206023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.141489:0:206023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 13 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.141506:0:206023:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917516800:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.141557:0:206023:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02393f856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777580327.141595:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917514752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.141643:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.141676:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917515264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.141711:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.141741:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777580327.141748:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917514624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.141936:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.141962:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917515136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.141985:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580327.142014:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514752 00000100:00100000:1.0:1777580327.142023:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514752 00000100:00100000:1.0:1777580327.142062:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917515264 00000100:00100000:1.0:1777580327.142065:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917515264 00000100:00100000:1.0:1777580327.142079:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917514624 00000100:00100000:1.0:1777580327.142081:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917514624 00000100:00100000:1.0:1777580327.142089:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917515136 00000100:00100000:1.0:1777580327.142091:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917515136 00000100:00100000:1.0:1777580327.142101:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12292 00000100:00100000:1.0:1777580327.142109:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917514752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777580327.142129:0:205905:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5636 count 1 00010000:00010000:1.0:1777580327.142171:0:205905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.142190:0:205905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.142197:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.142199:0:205905:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.142201:0:205905:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.142224:0:205905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.142248:0:205905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 13 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.142258:0:205905:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023d1673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917516928:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580327.142398:0:206352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12293 00000100:00100000:0.0:1777580327.142415:0:206352:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917515264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580327.142429:0:206352:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5639 count 1 00010000:00010000:0.0:1777580327.142441:0:206352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.142462:0:206352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.142469:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.142470:0:206352:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.142473:0:206352:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.142494:0:206352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 13 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.142503:0:206352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 13 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.142513:0:206352:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023853b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917517056:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.142569:0:205905:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0239fe32000 going to sleep for 11 seconds 00000100:00100000:0.0:1777580327.144567:0:206352:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423780 going to sleep for 11 seconds 00000100:00100000:2.0:1777580327.145434:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12294 00000100:00100000:2.0:1777580327.145559:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917514624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777580327.145610:0:193009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5634 count 1 00010000:00010000:2.0:1777580327.145640:0:193009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.145666:0:193009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 13 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.145707:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.145710:0:193009:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.145714:0:193009:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.145754:0:193009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 13 pid: 205905 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.145762:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12295 00010000:00010000:2.0:1777580327.145768:0:193009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 13 pid: 205905 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.145772:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1863919917515136:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777580327.145785:0:193009:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02486268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917517184:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580327.145859:0:193009:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02392200180 going to sleep for 11 seconds 00002000:00080000:0.0:1777580327.146443:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5637 count 1 00010000:00010000:0.0:1777580327.146461:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.146476:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.146498:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.146500:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.146502:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.146526:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.146536:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.146547:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917517312:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580327.146592:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777580327.156897:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580327.164383:0:205906:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:205906:1863919917515520:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.164422:0:205906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.164459:0:207637:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:207637:1863919917515648:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.164470:0:207637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.164503:0:206018:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:206018:1863919917515392:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.164513:0:206018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.169558:0:206357:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946848896 00000100:00100000:0.0:1777580327.169573:0:206357:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946848896 00010000:00010000:0.0:1777580327.169659:0:206357:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 14 pid: 188246 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.169713:0:206357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4541 00000100:00100000:0.0:1777580327.169724:0:206357:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2363:x1863919946848896:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777580327.169743:0:206357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777580327.169748:0:206357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 14 pid: 188246 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.169833:0:206357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 14 pid: 188246 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.169863:0:206357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050cdd37f/0xcb2b2f2f7e4dd3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f069 expref: 14 pid: 188246 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.169883:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.169885:0:206357:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.169890:0:206357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.169901:0:206357:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.169934:0:206357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580327.169996:0:206357:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+13:2363:x1863919946848896:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 275us (13112us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580327.170005:0:206357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4541 00000100:00100000:0.0:1777580327.170115:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580327.170205:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580327.170612:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849152 00000100:00100000:1.0:1777580327.170619:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849152 00010000:00010000:1.0:1777580327.170644:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 13 pid: 206020 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.170667:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849024 00000100:00100000:1.0:1777580327.170682:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849024 00010000:00010000:1.0:1777580327.170708:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 14 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.170727:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4542 00000100:00100000:1.0:1777580327.170736:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2363:x1863919946849152:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580327.170748:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580327.170752:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 14 pid: 206020 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170762:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 14 pid: 206020 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170779:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8bd5494/0xcb2b2f2f7e4dd5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f08c expref: 14 pid: 206020 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170806:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.170808:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.170812:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170820:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170843:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580327.170875:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+13:2363:x1863919946849152:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 141us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580327.170892:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4542 00000100:00100000:1.0:1777580327.170907:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4543 00000100:00100000:1.0:1777580327.170913:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+12:2363:x1863919946849024:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580327.170920:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580327.170925:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 12 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170936:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 12 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170949:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003deb8ee2/0xcb2b2f2f7e4e082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f18f expref: 12 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170959:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.170961:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.170964:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170972:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.170987:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580327.171002:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+11:2363:x1863919946849024:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 90us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580327.171008:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4543 00000100:00100000:1.0:1777580327.171067:0:205908:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:205908:1863919917516672:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.171095:0:205908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.171120:0:206023:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:206023:1863919917516800:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.171131:0:206023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.171174:0:205905:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023d1673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:205905:1863919917516928:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.171184:0:205905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.171214:0:207637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.171223:0:207637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.171234:0:207637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.171242:0:207637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.171260:0:207637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580327.172548:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.172771:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849408 00000100:00100000:2.0:1777580327.172781:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849408 00010000:00010000:2.0:1777580327.172828:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 14 pid: 205897 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.172866:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4544 00000100:00100000:2.0:1777580327.172877:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2363:x1863919946849408:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.172893:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.172899:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 14 pid: 205897 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.172929:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 14 pid: 205897 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.172958:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6ee231/0xcb2b2f2f7e4dd48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f077 expref: 14 pid: 205897 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.172975:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.172977:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.172982:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.172992:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.173023:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.173342:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+13:2363:x1863919946849408:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 411us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.173351:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4544 00000100:00100000:0.0:1777580327.174098:0:188248:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:188248:1863919917516544:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580327.174127:0:188248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.174193:0:206352:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:206352:1863919917517056:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580327.174205:0:206352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.175309:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917513472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47262us (59644us total) trans 8589938730 rc 0/0 00000100:00100000:1.0:1777580327.175320:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12282 00010000:00010000:1.0:1777580327.175363:0:205906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.175375:0:205906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.175386:0:205906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.175394:0:205906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.175415:0:205906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777580327.180472:0:205908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.180495:0:205908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.180510:0:205908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.180519:0:205908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.180548:0:205908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580327.181221:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181297:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181876:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181898:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.181988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.182006:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580327.182024:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580327.182950:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917513856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55400us (67336us total) trans 8589938731 rc 0/0 00000100:00100000:1.0:1777580327.182966:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12281 00000100:00100000:1.0:1777580327.183043:0:3290:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589938729 gen 2 00000004:00080000:1.0:1777580327.183048:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfaa00, transno 8589938703 00000004:00080000:1.0:1777580327.183063:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfa680, transno 8589938704 00000004:00080000:1.0:1777580327.183066:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfa300, transno 8589938705 00000004:00080000:1.0:1777580327.183068:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7dfad80, transno 8589938706 00000004:00080000:1.0:1777580327.183071:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7df9f80, transno 8589938707 00000004:00080000:1.0:1777580327.183074:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d500, transno 8589938708 00000004:00080000:1.0:1777580327.183077:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ed80, transno 8589938709 00000004:00080000:1.0:1777580327.183091:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095c380, transno 8589938710 00000004:00080000:1.0:1777580327.183095:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b7df8a80, transno 8589938711 00000004:00080000:1.0:1777580327.183097:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d880, transno 8589938712 00000004:00080000:1.0:1777580327.183100:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffe300, transno 8589938713 00000004:00080000:1.0:1777580327.183103:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b0a80, transno 8589938714 00000004:00080000:1.0:1777580327.183106:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095e300, transno 8589938715 00000004:00080000:1.0:1777580327.183109:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b2a00, transno 8589938716 00000004:00080000:1.0:1777580327.183112:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b3480, transno 8589938717 00000004:00080000:1.0:1777580327.183115:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095d180, transno 8589938718 00000004:00080000:1.0:1777580327.183118:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384fff800, transno 8589938719 00000004:00080000:1.0:1777580327.183121:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c2300, transno 8589938720 00000004:00080000:1.0:1777580327.183123:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b1180, transno 8589938721 00000004:00080000:1.0:1777580327.183126:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02390ed1c00, transno 8589938722 00000004:00080000:1.0:1777580327.183128:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02390ed3800, transno 8589938723 00000004:00080000:1.0:1777580327.183130:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02390ed3100, transno 8589938724 00000004:00080000:1.0:1777580327.183151:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1f800, transno 8589938725 00000004:00080000:1.0:1777580327.183154:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ea00, transno 8589938726 00000004:00080000:1.0:1777580327.183157:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02390ed1180, transno 8589938727 00000004:00080000:1.0:1777580327.183160:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30f800, transno 8589938728 00000004:00080000:1.0:1777580327.183163:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0249c30f480, transno 8589938729 00000100:00100000:1.0:1777580327.183171:0:3290:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa023a095f100 x1863919917513472/t8589938730(8589938730) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580343 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777580327.183183:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f100/2, rc 0, transno 8589938730 00000100:00100000:1.0:1777580327.183189:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513472:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580327.183206:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa024ac337100/2, rc 0, transno 8589938731 00000100:00100000:1.0:1777580327.183210:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ac337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777580327.183230:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580327.183241:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183262:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8a400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.183268:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183373:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183400:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183409:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a15d42/0xcb2b2f2f7e4e51a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 207637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183432:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580327.183436:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183442:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8bc00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.183446:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183454:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183462:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183476:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964941cd/0xcb2b2f2f7e4e513 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183492:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580327.183496:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183504:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838800 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.183507:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183514:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183526:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183533:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b44acdf/0xcb2b2f2f7e4e552 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.183547:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580327.183549:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580327.183550:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580327.183566:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849280 00000100:00100000:1.0:1777580327.183573:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849280 00010000:00010000:1.0:1777580327.183614:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 13 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183634:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849536 00000100:00100000:1.0:1777580327.183636:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849536 00010000:00010000:1.0:1777580327.183647:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 14 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183657:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849792 00000100:00100000:1.0:1777580327.183659:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849792 00010000:00010000:1.0:1777580327.183671:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 15 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183682:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850048 00000100:00100000:1.0:1777580327.183684:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850048 00010000:00010000:1.0:1777580327.183705:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 11 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183717:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850304 00000100:00100000:1.0:1777580327.183720:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850304 00010000:00010000:1.0:1777580327.183730:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 12 pid: 206352 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183739:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850560 00000100:00100000:1.0:1777580327.183742:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850560 00010000:00010000:1.0:1777580327.183754:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 16 pid: 188247 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.183763:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849920 00000100:00100000:1.0:1777580327.183771:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849920 00000100:00100000:2.0:1777580327.185991:0:188247:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0248626b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:188247:1863919917515776:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580327.186029:0:188247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.186810:0:189456:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:189456:1863919917516032:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580327.186832:0:189456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.186868:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850176 00000100:00100000:2.0:1777580327.186876:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850176 00010000:00010000:2.0:1777580327.186922:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 14 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.186947:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850432 00000100:00100000:2.0:1777580327.186950:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850432 00010000:00010000:2.0:1777580327.186964:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 15 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.186976:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850816 00000100:00100000:2.0:1777580327.186979:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850816 00010000:00010000:2.0:1777580327.186991:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 17 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.187023:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850688 00000100:00100000:2.0:1777580327.187026:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850688 00010000:00010000:2.0:1777580327.187038:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 18 pid: 205905 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.187573:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946849664 00000100:00100000:2.0:1777580327.187579:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946849664 00010000:00010000:2.0:1777580327.187597:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 19 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.187614:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4545 00000100:00100000:2.0:1777580327.187623:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+19:2364:x1863919946849280:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.187638:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.187644:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 19 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.187656:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 19 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.188183:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089eff852/0xcb2b2f2f7e4e089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f196 expref: 19 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.188203:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.188206:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.188222:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.188234:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.188274:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777580327.188451:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 15 pid: 207637 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.188482:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4546 00000100:00100000:1.0:1777580327.188493:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+18:2364:x1863919946849536:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580327.188503:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580327.188508:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 18 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.188519:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 18 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.188533:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084835baa/0xcb2b2f2f7e4e090 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f181 expref: 18 pid: 206023 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.188545:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.188547:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.188550:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.188559:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.188578:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.191250:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+17:2364:x1863919946849280:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3612us (10020us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.191269:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4545 00000100:00100000:2.0:1777580327.191326:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4547 00000100:00100000:2.0:1777580327.191342:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+16:2364:x1863919946849792:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.191771:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.191785:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 16 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.191806:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 16 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.191837:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ccab730/0xcb2b2f2f7e4e1c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ce expref: 16 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.191856:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.191859:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.191865:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.191900:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.191941:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.191984:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2364:x1863919946849792:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 649us (10685us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.191993:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4547 00000100:00100000:2.0:1777580327.192014:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4548 00000100:00100000:2.0:1777580327.192024:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2361:x1863919946850048:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.192035:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.192041:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 15 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.192594:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 15 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.192613:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.192615:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.192620:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.192629:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.192645:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.193190:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0248626a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+15:2361:x1863919946850048:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1165us (11348us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.193200:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4548 00000100:00100000:2.0:1777580327.193236:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4549 00000100:00100000:2.0:1777580327.193248:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2361:x1863919946850304:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.193262:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.193269:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 14 pid: 206352 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193281:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 14 pid: 206352 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193803:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdefc8c5/0xcb2b2f2f7e4e09e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ab expref: 14 pid: 206352 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193821:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.193823:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.193828:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193837:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193874:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.193907:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+13:2361:x1863919946850304:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 664us (12047us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.193914:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4549 00000100:00100000:2.0:1777580327.193951:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4550 00000100:00100000:2.0:1777580327.193959:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2361:x1863919946850560:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.193970:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.193975:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 14 pid: 188247 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193985:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 14 pid: 188247 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.193998:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.194000:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.194004:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.194010:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.194022:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.194041:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+14:2361:x1863919946850560:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 84us (12164us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.194604:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4550 00000100:00100000:2.0:1777580327.194631:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4551 00000100:00100000:2.0:1777580327.194643:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+12:2361:x1863919946850176:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.194653:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.194660:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 12 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.195432:0:205908:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917514368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 63089us (64507us total) trans 8589939129 rc 0/0 00000100:00100000:0.0:1777580327.195443:0:205908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12290 00010000:00010000:2.0:1777580327.195581:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 12 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.195605:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.195607:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.195612:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.195621:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.195621:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580327.195628:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580327.195641:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777580327.195667:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:205900:1863919917517312:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580327.195706:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.195756:0:206018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.195765:0:206018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.195776:0:206018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.196002:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+12:2361:x1863919946850176:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1362us (14070us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.196011:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4551 00000100:00100000:2.0:1777580327.196035:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4552 00000100:00100000:2.0:1777580327.196361:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+11:2361:x1863919946850432:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.196558:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.196567:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 11 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.196580:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 11 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.196613:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.196615:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.196620:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.196628:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.196645:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.197172:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+11:2361:x1863919946850432:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1127us (15227us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.197181:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4552 00000100:00100000:2.0:1777580327.197211:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4553 00000100:00100000:2.0:1777580327.197222:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+13:2364:x1863919946850816:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.197232:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.197239:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.197251:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.197268:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0e6771/0xcb2b2f2f7e4e0a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1a4 expref: 13 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.197576:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.197578:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.197583:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.197592:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.197629:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.198155:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0249c30c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+12:2364:x1863919946850816:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 445us (15675us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.198166:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4553 00000100:00100000:2.0:1777580327.198193:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4554 00000100:00100000:2.0:1777580327.198204:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+11:2364:x1863919946850688:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.198214:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.198220:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 11 pid: 205905 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198232:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 11 pid: 205905 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198248:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.198250:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.198253:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198363:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198764:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.198811:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+11:2364:x1863919946850688:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 609us (16802us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.198819:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4554 00000100:00100000:2.0:1777580327.198841:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4555 00000100:00100000:2.0:1777580327.198849:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+10:2363:x1863919946849664:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.198857:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.198863:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 10 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198874:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 10 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198888:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d930c72/0xcb2b2f2f7e4e07b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f188 expref: 10 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198901:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.198902:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.198905:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198926:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.198956:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.198976:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+9:2363:x1863919946849664:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 129us (16951us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.198983:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4555 00000100:00100000:2.0:1777580327.198998:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4556 00000100:00100000:2.0:1777580327.199006:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+10:2361:x1863919946849920:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777580327.199015:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580327.199020:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 10 pid: 207637 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.199031:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 10 pid: 207637 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.199044:0:187616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ecf964/0xcb2b2f2f7e4e043 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f173 expref: 10 pid: 207637 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.199725:0:206018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.199760:0:206018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777580327.200337:0:206018:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0239667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917513344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 84118us (84810us total) trans 8589938732 rc 0/0 00000100:00100000:0.0:1777580327.200347:0:206018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12280 00010000:00010000:2.0:1777580327.200560:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.200562:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.200568:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.200595:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.200636:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777580327.201155:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+9:2361:x1863919946849920:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 2126us (19233us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580327.201165:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4556 00010000:00010000:2.0:1777580327.201238:0:193009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea7777b/0xcb2b2f2f7e4dffd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f16c expref: 8 pid: 205905 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.201250:0:193009:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02486268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:193009:1863919917517184:192.168.202.9@tcp:104: 00000100:00100000:1.0:1777580327.201650:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02486269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+7:2364:x1863919946849536:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 13158us (20370us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580327.201673:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4546 00010000:00010000:1.0:1777580327.201767:0:205896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170cf63d/0xcb2b2f2f7e4e097 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f19d expref: 8 pid: 205898 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.201794:0:205896:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:205896:1863919917515904:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.201811:0:205896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.201812:0:193009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.201824:0:193009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.201824:0:205896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.201833:0:193009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.201833:0:205896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.201844:0:193009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.201845:0:205896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.201853:0:193009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.201853:0:205896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.201874:0:205896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777580327.202169:0:193009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1777580327.202304:0:205896:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aece0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3290:x1863919917513984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 74088us (86580us total) trans 8589938733 rc 0/0 00000100:00100000:1.0:1777580327.202311:0:205896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12283 00010000:00010000:1.0:1777580327.202348:0:205895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea7661b0/0xcb2b2f2f7e4e074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f17a expref: 7 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.202368:0:205895:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:205895:1863919917516160:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.202383:0:205895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202391:0:205895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202398:0:205895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202405:0:205895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202413:0:205895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202428:0:205895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1777580327.202660:0:205895:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917513728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 74215us (86795us total) trans 8589938734 rc 0/0 00000100:00100000:1.0:1777580327.202667:0:205895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12286 00010000:00010000:1.0:1777580327.202716:0:205897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a4d8e03/0xcb2b2f2f7e4e1d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1e3 expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.202729:0:205897:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:205897:1863919917516288:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.202749:0:205897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202758:0:205897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202766:0:205897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202774:0:205897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202782:0:205897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.202792:0:205897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1777580327.203003:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917514240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 74421us (87105us total) trans 8589938735 rc 0/0 00000100:00100000:1.0:1777580327.203010:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12287 00010000:00010000:1.0:1777580327.203040:0:188246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069743e0e/0xcb2b2f2f7e4dd56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f085 expref: 6 pid: 188247 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.203052:0:188246:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:188246:1863919917516416:192.168.202.9@tcp:104: 00010000:00010000:1.0:1777580327.203063:0:188246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203082:0:188246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203089:0:188246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203096:0:188246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203104:0:188246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203112:0:188246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1777580327.203391:0:188246:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917514496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72302us (73181us total) trans 8589939130 rc 0/0 00000100:00100000:1.0:1777580327.203397:0:188246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12288 00010000:00010000:1.0:1777580327.203427:0:206023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203436:0:206023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203443:0:206023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203462:0:206023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203471:0:206023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1777580327.203638:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917514624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 58191us (61855us total) trans 8589939131 rc 0/0 00000100:00100000:2.0:1777580327.203646:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12294 00000100:00100000:1.0:1777580327.203724:0:206023:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917514880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62854us (72762us total) trans 8589939132 rc 0/0 00000100:00100000:1.0:1777580327.203730:0:206023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12291 00010000:00010000:1.0:1777580327.203752:0:205905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203761:0:205905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203769:0:205905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203775:0:205905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.203782:0:205905:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1777580327.204017:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917514752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61908us (62373us total) trans 8589939133 rc 0/0 00000100:00100000:1.0:1777580327.204023:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12292 00010000:00010000:1.0:1777580327.204042:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1777580327.204050:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204066:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ae00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204070:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204079:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204101:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204109:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c692814/0xcb2b2f2f7e4e50c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.204129:0:188248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.204168:0:188248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.204176:0:188248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.204183:0:188248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204191:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1777580327.204192:0:188248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1777580327.204195:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204201:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8ba00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204204:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204211:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204220:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204234:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f3616e/0xcb2b2f2f7e4e521 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204249:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1777580327.204253:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204259:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204262:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204269:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204280:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204287:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000630528ff/0xcb2b2f2f7e4e56e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 193009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204300:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1777580327.204303:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204309:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8b200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204318:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204325:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204335:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204343:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f97e1e/0xcb2b2f2f7e4e536 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204356:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1777580327.204360:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204365:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02496d8be00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204368:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204375:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204383:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204389:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e2d101a/0xcb2b2f2f7e4e53d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204407:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777580327.204411:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204418:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024c62d9600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204421:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204428:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204438:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204445:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d781ba/0xcb2b2f2f7e4e544 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204459:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777580327.204462:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204469:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484839000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204471:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204489:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204499:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204505:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ded7f9/0xcb2b2f2f7e4e559 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204518:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777580327.204521:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204527:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02484838e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204531:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204538:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204547:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204554:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003201ca5d/0xcb2b2f2f7e4e560 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204579:0:187618:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777580327.204582:0:187618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204590:0:187618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1c00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:1.0:1777580327.204593:0:187618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204600:0:187618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204609:0:187618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204616:0:187618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3d1b26/0xcb2b2f2f7e4e54b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.204626:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580327.204628:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580327.204630:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580327.204672:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023e64dbb80/2, rc 0, transno 8589938733 00000100:00100000:1.0:1777580327.204681:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513984:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1777580327.204693:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095c700/2, rc 0, transno 8589938732 00010000:00010000:0.0:1777580327.204886:0:188247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.204896:0:188247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.204904:0:188247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.204923:0:188247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.204942:0:188247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580327.205009:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917515008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72947us (74748us total) trans 8589939134 rc 0/0 00000100:00100000:2.0:1777580327.205018:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12289 00010000:00010000:2.0:1777580327.205064:0:206352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.205074:0:206352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.205092:0:206352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.205100:0:206352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.205109:0:206352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1777580327.205232:0:188247:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917513600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 76990us (89458us total) trans 8589938736 rc 0/0 00000100:00100000:0.0:1777580327.205240:0:188247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12284 00000100:00100000:2.0:1777580327.207973:0:206352:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917515264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65557us (66251us total) trans 8589939135 rc 0/0 00000100:00100000:2.0:1777580327.207987:0:206352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12293 00010000:00010000:2.0:1777580327.208043:0:189456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.208072:0:189456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.208083:0:189456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.208091:0:189456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.208105:0:189456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1777580327.210076:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aced0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3288:x1863919917514112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 81673us (94248us total) trans 8589938737 rc 0/0 00000100:00100000:2.0:1777580327.210103:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12285 00010000:00010000:2.0:1777580327.211124:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.211163:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.211177:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.211186:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.211200:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1777580327.211775:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777580327.211794:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211803:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580327.211808:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211817:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211840:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211847:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c674023/0xcb2b2f2f7e4e528 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 188247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211870:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777580327.211883:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211890:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1000 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580327.211893:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211900:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211910:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211917:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0be3b81/0xcb2b2f2f7e4e567 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211930:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777580327.211934:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211940:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580327.211943:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211950:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211971:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211978:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e63b261c/0xcb2b2f2f7e4e52f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 189456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.211993:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580327.211997:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.212003:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff1200 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580327.212006:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.212013:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.212021:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.212027:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c1aeea/0xcb2b2f2f7e4e575 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.212038:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580327.212040:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580327.212046:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580327.212099:0:3291:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589939128 gen 2 00000004:00080000:0.0:1777580327.212105:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388925500, transno 8589939103 00000004:00080000:0.0:1777580327.212118:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388927480, transno 8589939104 00000004:00080000:0.0:1777580327.212122:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388925c00, transno 8589939105 00000004:00080000:0.0:1777580327.212125:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388926300, transno 8589939106 00000004:00080000:0.0:1777580327.212128:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388926a00, transno 8589939107 00000004:00080000:0.0:1777580327.212130:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388927100, transno 8589939108 00000004:00080000:0.0:1777580327.212147:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388924a80, transno 8589939109 00000004:00080000:0.0:1777580327.212150:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ce00, transno 8589939110 00000004:00080000:0.0:1777580327.212153:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384fff100, transno 8589939111 00000004:00080000:0.0:1777580327.212156:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffca80, transno 8589939112 00000004:00080000:0.0:1777580327.212159:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55fbb80, transno 8589939113 00000004:00080000:0.0:1777580327.212162:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02496fc8700, transno 8589939114 00000004:00080000:0.0:1777580327.212164:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffe680, transno 8589939115 00000004:00080000:0.0:1777580327.212167:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55f8a80, transno 8589939116 00000004:00080000:0.0:1777580327.212169:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1c000, transno 8589939117 00000004:00080000:0.0:1777580327.212171:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384fff480, transno 8589939118 00000004:00080000:0.0:1777580327.212174:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024b55c4000, transno 8589939119 00000004:00080000:0.0:1777580327.212177:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02390ed3480, transno 8589939120 00000004:00080000:0.0:1777580327.212179:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1c380, transno 8589939121 00000004:00080000:0.0:1777580327.212182:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ca80, transno 8589939122 00000004:00080000:0.0:1777580327.212184:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1f480, transno 8589939123 00000004:00080000:0.0:1777580327.212187:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aec39880, transno 8589939124 00000004:00080000:0.0:1777580327.212190:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024aec3b480, transno 8589939125 00000004:00080000:0.0:1777580327.212192:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4700, transno 8589939126 00000004:00080000:0.0:1777580327.212195:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e4380, transno 8589939127 00000004:00080000:0.0:1777580327.212197:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023871e7800, transno 8589939128 00000100:00100000:0.0:1777580327.212207:0:3291:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffffa02388b1d500 x1863919917514368/t8589939129(8589939129) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777580343 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1777580327.212232:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1d500/2, rc 0, transno 8589939129 00000100:00100000:0.0:1777580327.212238:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514368:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.212253:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1ed80/2, rc 0, transno 8589939132 00000100:00100000:0.0:1777580327.212257:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514880:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.212266:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1c700/2, rc 0, transno 8589939130 00000100:00100000:0.0:1777580327.212270:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917514496:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.212278:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1d180/2, rc 0, transno 8589939134 00000100:00100000:0.0:1777580327.212282:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917515008:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.212558:0:187652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 26 done 00000004:00080000:0.0:1777580327.212842:0:187654:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 27 done 00000100:00100000:0.0:1777580327.212891:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917517568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777580327.212930:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580327.212958:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777580327.212964:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917517440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777580327.212981:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580327.213132:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3289:x1863919917515136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66892us (70676us total) trans 8589939136 rc 0/0 00000100:00100000:2.0:1777580327.213160:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12295 00000100:00100000:2.0:1777580327.213188:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917517568 00000100:00100000:2.0:1777580327.213194:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917517568 00000100:00100000:2.0:1777580327.213231:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917517440 00000100:00100000:2.0:1777580327.213234:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917517440 00000100:00100000:2.0:1777580327.213253:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12296 00000100:00100000:2.0:1777580327.213261:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917517568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1777580327.213448:0:205900:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5603 count 1 00010000:00010000:2.0:1777580327.213611:0:205900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.213645:0:205900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 5 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.213654:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.213656:0:205900:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777580327.213660:0:205900:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.216006:0:205900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 5 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.216029:0:205900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 5 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.216445:0:205900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917517696:192.168.202.9@tcp:104: 00000100:00100000:2.0:1777580327.216798:0:205900:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02392200180 going to sleep for 11 seconds 00010000:00010000:2.0:1777580327.216826:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580327.217910:0:206021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12297 00000100:00100000:0.0:1777580327.217935:0:206021:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3291:x1863919917517440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777580327.217976:0:206021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5640 count 1 00010000:00010000:0.0:1777580327.218006:0:206021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.218030:0:206021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 5 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.218062:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.218064:0:206021:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777580327.218068:0:206021:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.218106:0:206021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 5 pid: 205907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.218118:0:206021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 5 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.218155:0:206021:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917517824:192.168.202.9@tcp:104: 00000100:00100000:0.0:1777580327.218223:0:206021:0:(client.c:2691:ptlrpc_set_wait()) set ffffa02389423240 going to sleep for 11 seconds 00010000:00010000:0.0:1777580327.218237:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580327.218284:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095f800/2, rc 0, transno 8589938734 00000100:00100000:0.0:1777580327.218292:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513728:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580327.218305:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02397d5df80/2, rc 0, transno 8589938735 00000100:00100000:0.0:1777580327.218308:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02397d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917514240:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580327.218318:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023a095ca80/2, rc 0, transno 8589938736 00000100:00100000:0.0:1777580327.218321:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917513600:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1777580327.218329:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023e64daa00/2, rc 0, transno 8589938737 00000100:00100000:0.0:1777580327.218332:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917514112:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777580327.218348:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580327.218380:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1d880/2, rc 0, transno 8589939131 00000100:00100000:0.0:1777580327.218386:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917514624:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.218396:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b0380/2, rc 0, transno 8589939136 00000100:00100000:0.0:1777580327.218399:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917515136:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.218407:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02388b1f100/2, rc 0, transno 8589939133 00000100:00100000:0.0:1777580327.218410:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02388b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917514752:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777580327.218419:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa023853b1c00/2, rc 0, transno 8589939135 00000100:00100000:0.0:1777580327.218422:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023853b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917515264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.219102:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1863919917513344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1777580327.226018:0:205900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:205900:1863919917517696:192.168.202.9@tcp:104: 00010000:00010000:2.0:1777580327.226068:0:205900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580327.237826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580327.237911:0:187616:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851072 00000100:00100000:1.0:1777580327.237929:0:187616:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851072 00010000:00010000:1.0:1777580327.237981:0:187616:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.238035:0:187616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4557 00000100:00100000:1.0:1777580327.238047:0:187616:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+6:2361:x1863919946851072:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580327.238067:0:187616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580327.238075:0:187616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.238090:0:187616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.238122:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.238125:0:187616:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.238131:0:187616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.238184:0:187616:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.238208:0:187616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777580327.238270:0:187616:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+6:2361:x1863919946851072:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 225us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580327.238277:0:187616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4557 00010000:00010000:0.0:1777580327.238690:0:206021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caaabfd8/0xcb2b2f2f7e4e1d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1dc expref: 5 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777580327.238719:0:206021:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:206021:1863919917517824:192.168.202.9@tcp:104: 00010000:00010000:0.0:1777580327.238756:0:206021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.238767:0:206021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.238774:0:206021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.238798:0:206021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.238806:0:206021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.238836:0:206021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777580327.238843:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580327.239355:0:206021:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917517440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21432us (26370us total) trans 8589939137 rc 0/0 00000100:00100000:0.0:1777580327.239364:0:206021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12297 00010000:00010000:0.0:1777580327.239393:0:208519:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777580327.239402:0:208519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.239410:0:208519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa023deff0e00 already unused, calling callback (ffffffffc157f320) 00010000:00010000:0.0:1777580327.239415:0:208519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.239424:0:208519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.239440:0:208519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.239447:0:208519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aaf16d/0xcb2b2f2f7e4e583 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580327.239467:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580327.239470:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580327.239471:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777580327.239501:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384fff100/2, rc 0, transno 8589939137 00000100:00100000:0.0:1777580327.239515:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917517440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777580327.242151:0:187617:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946850944 00000100:00100000:1.0:1777580327.242166:0:187617:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946850944 00010000:00010000:1.0:1777580327.242223:0:187617:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.242279:0:187617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4558 00000100:00100000:1.0:1777580327.242290:0:187617:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024aeea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+6:2361:x1863919946850944:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777580327.242309:0:187617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777580327.242316:0:187617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.242331:0:187617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.242357:0:187617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000916d3747/0xcb2b2f2f7e4e1cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1d5 expref: 6 pid: 205907 timeout: 7948 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.242374:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.242376:0:187617:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777580327.242382:0:187617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.242392:0:187617:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777580327.242431:0:187617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777580327.242453:0:205900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580327.242473:0:205900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580327.242484:0:205900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.242486:0:187617:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024aeea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2361:x1863919946850944:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 198us (3643us total) trans 0 rc 0/0 00010000:00010000:3.0:1777580327.242494:0:205900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580327.242494:0:187617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4558 00010000:00010000:3.0:1777580327.242523:0:205900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777580327.243077:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1863919917517568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29814us (30144us total) trans 8589938738 rc 0/0 00000100:00100000:3.0:1777580327.243086:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12296 00010000:00010000:2.0:1777580327.243592:0:188704:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777580327.243601:0:188704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.243629:0:188704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680e600 already unused, calling callback (ffffffffc157f320) 00010000:00010000:2.0:1777580327.243635:0:188704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.243644:0:188704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.243661:0:188704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.243669:0:188704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3e8cfd/0xcb2b2f2f7e4e57c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580327.243690:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580327.243692:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777580327.244131:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02384ffe300/2, rc 0, transno 8589938738 00000100:00100000:1.0:1777580327.244155:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917517568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777580327.245170:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580327.467341:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3288:1863919917517952:0@lo:400:kworker.0 00000100:00100000:0.0:1777580327.467425:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580327.467481:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777580327.467487:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917518080:0@lo:400:kworker.0 00000100:00100000:0.0:1777580327.467515:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580327.467611:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1863919917518208:0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.467646:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580327.467668:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777580327.467673:0:3290:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1863919917518336:0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.467704:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777580327.467735:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518080 00000100:00100000:3.0:1777580327.467742:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518080 00000100:00100000:3.0:1777580327.467794:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518208 00000100:00100000:3.0:1777580327.467796:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518208 00000100:00100000:3.0:1777580327.467825:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518336 00000100:00100000:3.0:1777580327.467827:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518336 00000100:00100000:3.0:1777580327.467846:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1777580327.467855:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.467906:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917518080:12345-0@lo:400:kworker.0 Request processed in 52us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580327.467914:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1777580327.467931:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1777580327.467936:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1863919917518208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.467959:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1863919917518208:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580327.467965:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1777580327.467994:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1777580327.467999:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3290:x1863919917518336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.468022:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3290:x1863919917518336:12345-0@lo:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580327.468027:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00080000:3.0:1777580327.468048:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580327.468086:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917518080:0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.468113:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1863919917518336:0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.468121:0:3290:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1863919917518208:0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.468177:0:187624:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917517952 00000100:00100000:3.0:1777580327.468181:0:187624:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917517952 00000100:00100000:3.0:1777580327.468203:0:187624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1777580327.468208:0:187624:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3288:x1863919917517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580327.468239:0:187624:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3288:x1863919917517952:12345-0@lo:400:kworker.0 Request processed in 31us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580327.468245:0:187624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1777580327.468279:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3288:1863919917517952:0@lo:400:kworker.0 00010000:00010000:0.0:1777580327.659516:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580328.491877:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777580328.491901:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777580328.491978:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580328.492189:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518464 00000100:00100000:0.0:1777580328.492198:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518464 00000100:00100000:0.0:1777580328.492248:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1777580328.492258:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3289:x1863919917518464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777580328.492299:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1777580328.492355:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3289:x1863919917518464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580328.492365:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1777580328.492819:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777580328.493752:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777580328.493770:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917518592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777580328.493831:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580328.493885:0:192556:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518592 00000100:00100000:0.0:1777580328.493891:0:192556:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518592 00000100:00100000:0.0:1777580328.493945:0:192556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1777580328.493955:0:192556:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917518592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777580328.493987:0:192556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3819962368 avail 3817865216 00000100:00100000:0.0:1777580328.494039:0:192556:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3288:x1863919917518592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580328.494046:0:192556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1777580328.494216:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917518592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1777580328.685756:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580329.706404:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580330.752684:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777580331.266175:0:6562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 8589939137 is committed 00000001:00080000:3.0:1777580331.311031:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938736 is committed 00000001:00080000:3.0:1777580331.311060:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938737 is committed 00000001:00080000:3.0:1777580331.311085:0:7429:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 8589938738 is committed 00010000:00010000:1.0:1777580331.755073:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580332.187307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187505:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.187551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580332.188789:0:187625:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851200 00000100:00100000:3.0:1777580332.188803:0:187625:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851200 00000100:00100000:3.0:1777580332.188876:0:187625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 429 00000100:00100000:3.0:1777580332.188887:0:187625:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2363:x1863919946851200:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580332.188973:0:187625:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2363:x1863919946851200:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 88us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.188981:0:187625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 429 00000100:00100000:3.0:1777580332.189021:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851712 00000100:00100000:3.0:1777580332.189026:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851712 00000100:00100000:3.0:1777580332.189061:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851328 00000100:00100000:3.0:1777580332.189065:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851328 00000100:00100000:3.0:1777580332.189086:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 512 00000100:00100000:3.0:1777580332.189092:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2363:x1863919946851712:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580332.189156:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2363:x1863919946851712:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 43us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.189163:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 512 00000100:00100000:3.0:1777580332.189176:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 513 00000100:00100000:3.0:1777580332.189182:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946851328:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1777580332.189208:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946851328:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.189225:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 513 00000100:00100000:1.0:1777580332.189935:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851456 00000100:00100000:1.0:1777580332.189942:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851456 00000100:00100000:1.0:1777580332.189999:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851968 00000100:00100000:1.0:1777580332.190003:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851968 00000100:00100000:1.0:1777580332.190022:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851584 00000100:00100000:1.0:1777580332.190026:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851584 00000100:00100000:1.0:1777580332.190043:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946851840 00000100:00100000:1.0:1777580332.190046:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946851840 00000100:00100000:1.0:1777580332.190067:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 340 00000100:00100000:1.0:1777580332.190076:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2363:x1863919946851456:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580332.190195:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2363:x1863919946851456:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 119us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580332.190202:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 340 00000100:00100000:1.0:1777580332.190222:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 341 00000100:00100000:1.0:1777580332.190242:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2363:x1863919946851968:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580332.190308:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2363:x1863919946851968:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 80us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580332.190315:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 341 00000100:00100000:1.0:1777580332.190329:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 342 00000100:00100000:1.0:1777580332.190335:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2363:x1863919946851584:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580332.190370:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2363:x1863919946851584:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580332.190377:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 342 00000100:00100000:1.0:1777580332.190403:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 343 00000100:00100000:1.0:1777580332.190409:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2363:x1863919946851840:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580332.190452:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2363:x1863919946851840:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 43us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580332.190458:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 343 00000100:00080000:2.0:1777580332.193221:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777580332.193242:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777580332.193246:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777580332.599297:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917519104:0@lo:400:kworker.0 00000100:00100000:0.0:1777580332.599394:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580332.599463:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580332.599471:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917518976:0@lo:400:kworker.0 00000100:00100000:0.0:1777580332.599499:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580332.600115:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518976 00000100:00100000:2.0:1777580332.600126:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518976 00000100:00100000:2.0:1777580332.600249:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1777580332.600260:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917518976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580332.600354:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917518976:12345-0@lo:400:kworker.0 Request processed in 96us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580332.600384:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1777580332.600410:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777580332.600446:0:3289:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589938738 gen 2 00000004:00080000:2.0:1777580332.600453:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f100, transno 8589938730 00000004:00080000:2.0:1777580332.600461:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa024ac337100, transno 8589938731 00000004:00080000:2.0:1777580332.600464:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095c700, transno 8589938732 00000004:00080000:2.0:1777580332.600512:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023e64dbb80, transno 8589938733 00000004:00080000:2.0:1777580332.600515:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095f800, transno 8589938734 00000004:00080000:2.0:1777580332.600518:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02397d5df80, transno 8589938735 00000004:00080000:2.0:1777580332.600521:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023a095ca80, transno 8589938736 00000004:00080000:2.0:1777580332.600524:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023e64daa00, transno 8589938737 00000004:00080000:2.0:1777580332.600526:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384ffe300, transno 8589938738 00000100:00100000:2.0:1777580332.600533:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917518976:0@lo:400:kworker.0 00000004:00080000:0.0:1777580332.601537:0:187654:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1777580332.601709:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917518848:0@lo:400:kworker.0 00000100:00100000:1.0:1777580332.601794:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580332.601840:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917519360:0@lo:400:kworker.0 00000100:00100000:1.0:1777580332.601867:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580332.601897:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1777580332.601905:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917518720:0@lo:400:kworker.0 00000100:00100000:1.0:1777580332.601935:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580332.601960:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917519232:0@lo:400:kworker.0 00000100:00100000:1.0:1777580332.601981:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580332.604761:0:205905:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518848 00000100:00100000:2.0:1777580332.604779:0:205905:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518848 00000100:00100000:2.0:1777580332.604877:0:205905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1777580332.604888:0:205905:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917518848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580332.605009:0:205905:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917518848:12345-0@lo:400:kworker.0 Request processed in 123us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580332.605017:0:205905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:2.0:1777580332.605045:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777580332.605088:0:3291:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589939137 gen 2 00000004:00080000:2.0:1777580332.605095:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1d500, transno 8589939129 00000004:00080000:2.0:1777580332.605109:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1c700, transno 8589939130 00000004:00080000:2.0:1777580332.605113:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1d880, transno 8589939131 00000004:00080000:2.0:1777580332.605116:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1ed80, transno 8589939132 00000004:00080000:2.0:1777580332.605118:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1f100, transno 8589939133 00000004:00080000:2.0:1777580332.605171:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02388b1d180, transno 8589939134 00000004:00080000:2.0:1777580332.605174:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b1c00, transno 8589939135 00000004:00080000:2.0:1777580332.605176:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa023853b0380, transno 8589939136 00000004:00080000:2.0:1777580332.605179:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02384fff100, transno 8589939137 00000100:00100000:2.0:1777580332.605188:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917518848:0@lo:400:kworker.0 00000004:00080000:2.0:1777580332.605517:0:187652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:3.0:1777580332.607484:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519104 00000100:00100000:3.0:1777580332.607494:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519104 00000100:00100000:3.0:1777580332.607598:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519360 00000100:00100000:3.0:1777580332.607601:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519360 00000100:00100000:3.0:1777580332.607626:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519232 00000100:00100000:3.0:1777580332.607629:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519232 00000100:00100000:3.0:1777580332.607663:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1777580332.607673:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580332.607792:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917519104:12345-0@lo:400:kworker.0 Request processed in 121us (8398us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.607798:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1777580332.607814:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1777580332.607818:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917519360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580332.607844:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917519360:12345-0@lo:400:kworker.0 Request processed in 26us (5976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.607848:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1777580332.607854:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1777580332.607857:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917519232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580332.607874:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023d1673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917519232:12345-0@lo:400:kworker.0 Request processed in 17us (5893us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.607877:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1777580332.607895:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917518720 00000100:00100000:3.0:1777580332.607898:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917518720 00000100:00100000:3.0:1777580332.607915:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1777580332.607919:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024c5f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917518720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777580332.607963:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024c5f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917518720:12345-0@lo:400:kworker.0 Request processed in 44us (6027us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580332.607969:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00080000:2.0:1777580332.609751:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777580332.609811:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917518720:0@lo:400:kworker.0 00000100:00100000:2.0:1777580332.609835:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917519232:0@lo:400:kworker.0 00000100:00100000:2.0:1777580332.609849:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917519360:0@lo:400:kworker.0 00000100:00100000:2.0:1777580332.609896:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917519104:0@lo:400:kworker.0 00010000:00010000:0.0:1777580332.785806:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580333.610981:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023871e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917519488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777580333.611106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580333.611353:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777580333.611363:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917519616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777580333.611391:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580333.611424:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519488 00000100:00100000:0.0:1777580333.611432:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519488 00000100:00100000:0.0:1777580333.611479:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519616 00000100:00100000:0.0:1777580333.611482:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519616 00000100:00100000:0.0:1777580333.611499:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1777580333.611508:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917519488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777580333.611551:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1777580333.611598:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917519488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580333.611605:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1777580333.611624:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1777580333.611631:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917519616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777580333.611661:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3819962368 avail 3817865216 00000100:00100000:0.0:1777580333.611688:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917519616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580333.611713:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1777580333.611761:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917519616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777580333.611778:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023871e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917519488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777580333.817398:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580334.827848:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777580335.850423:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580336.874605:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777580337.232171:0:210076:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 16:18:54 (1777580334) 00000100:00100000:1.0:1777580337.321281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321369:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321400:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321423:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321444:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580337.321589:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852352 00000100:00100000:1.0:1777580337.321612:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852352 00000100:00100000:1.0:1777580337.321696:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852864 00000100:00100000:1.0:1777580337.321699:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852864 00000100:00100000:1.0:1777580337.321747:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852480 00000100:00100000:1.0:1777580337.321750:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852480 00000100:00100000:1.0:1777580337.321771:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852736 00000100:00100000:1.0:1777580337.321774:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852736 00000100:00100000:1.0:1777580337.321798:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 346 00000100:00100000:1.0:1777580337.321809:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946852352:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580337.321919:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b55fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946852352:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 110us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580337.321928:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 346 00000100:00100000:1.0:1777580337.321950:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 347 00000100:00100000:1.0:1777580337.321956:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2362:x1863919946852864:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580337.321999:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2362:x1863919946852864:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 43us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580337.322006:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 347 00000100:00100000:1.0:1777580337.322018:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 348 00000100:00100000:1.0:1777580337.322024:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946852480:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580337.322066:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946852480:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 42us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580337.322072:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 348 00000100:00100000:1.0:1777580337.322088:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 349 00000100:00100000:1.0:1777580337.322097:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2362:x1863919946852736:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1777580337.322202:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2362:x1863919946852736:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 108us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580337.322209:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 349 00000100:00100000:2.0:1777580337.322727:0:187624:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852096 00000100:00100000:2.0:1777580337.322734:0:187624:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852096 00000100:00100000:2.0:1777580337.322784:0:187624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 431 00000100:00100000:2.0:1777580337.322791:0:187624:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946852096:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1777580337.322826:0:187624:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946852096:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 36us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.322832:0:187624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 431 00000100:00080000:2.0:1777580337.322875:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777580337.322880:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777580337.324217:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852608 00000100:00100000:2.0:1777580337.324233:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852608 00000100:00100000:2.0:1777580337.324298:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852224 00000100:00100000:2.0:1777580337.324302:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852224 00000100:00100000:2.0:1777580337.324349:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 517 00000100:00100000:2.0:1777580337.324358:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2362:x1863919946852608:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1777580337.324458:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02496e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2362:x1863919946852608:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 101us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.324464:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 517 00000100:00100000:2.0:1777580337.324480:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 518 00000100:00100000:2.0:1777580337.324486:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946852224:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1777580337.324526:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02385fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2362:x1863919946852224:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 41us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.324532:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 518 00000100:00080000:1.0:1777580337.325279:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580337.431452:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580337.431500:0:207396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946852992 00000100:00100000:3.0:1777580337.431512:0:207396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946852992 00000100:00100000:3.0:1777580337.431577:0:207396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 880 00000100:00100000:3.0:1777580337.431588:0:207396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:283864:x1863919946852992:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1777580337.431626:0:207396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580337.431656:0:207396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4e58a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1f8 expref: -99 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.431740:0:207396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.431756:0:207396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.431773:0:207396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777580337.431908:0:207396:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 71168 00000004:00200000:3.0:1777580337.431913:0:207396:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 83 stripe count 1 MDT count 1 00000004:00010000:3.0:1777580337.431946:0:207396:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 207396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.431998:0:207396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1c00/0xcb2b2f2f7e4e58a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1f8 expref: 30 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.432020:0:207396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1f8 expref: 29 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.432030:0:207396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580337.432033:0:207396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777580337.432037:0:207396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0000, rc 0) 00000100:00100000:3.0:1777580337.432107:0:207396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:283864:x1863919946852992:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 521us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1777580337.432115:0:207396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 880 00000100:00100000:2.0:1777580337.446288:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580337.447839:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853120 00000100:00100000:3.0:1777580337.447855:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853120 00000100:00100000:3.0:1777580337.447943:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 881 00000100:00100000:3.0:1777580337.447955:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:283864:x1863919946853120:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1777580337.447982:0:205914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777580337.448010:0:205914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4e598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x227ed79ccf90f1ff expref: -99 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448097:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448114:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448149:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448219:0:205914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448228:0:205914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448236:0:205914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448667:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448677:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448684:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448690:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580337.448695:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448703:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448715:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580337.448719:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580337.448724:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448731:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1400/0xcb2b2f2f7e4e59f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448746:0:205914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448753:0:205914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448759:0:205914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448764:0:205914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024b54d1000 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:3.0:1777580337.448767:0:205914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448772:0:205914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448778:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffffa024185aa100) 00010000:00010000:3.0:1777580337.448781:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580337.448783:0:205914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448788:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d1000/0xcb2b2f2f7e4e5a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205914 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448827:0:205914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4e598 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ff expref: 30 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448838:0:205914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024185aac00) 00010000:00010000:3.0:1777580337.448841:0:205914:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777580337.448845:0:205914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0e00/0xcb2b2f2f7e4e598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1ff expref: 30 pid: 205914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777580337.448855:0:205914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa024b54d0e00, rc 0) 00000100:00100000:3.0:1777580337.448941:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:283864:x1863919946853120:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 988us (2661us total) trans 0 rc 301/301 00000100:00100000:3.0:1777580337.448950:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 881 00000100:00100000:3.0:1777580337.466866:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1777580337.467457:0:187631:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853376 00000100:00100000:2.0:1777580337.467470:0:187631:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853376 00000100:00100000:2.0:1777580337.467538:0:187631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 882 00000100:00100000:2.0:1777580337.467550:0:187631:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:283864:x1863919946853376:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:2.0:1777580337.467683:0:187631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777580337.467717:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024b54d0000/0xcb2b2f2f7e4e591 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0x227ed79ccf90f1f8 expref: 29 pid: 207396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.467803:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa024185aac00) 00010000:00010000:2.0:1777580337.467817:0:187631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777580337.468063:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.468078:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.468522:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.468538:0:187631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.468546:0:187631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.468553:0:187631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777580337.472770:0:187631:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x855:0x0]: returning size 512 00010000:00010000:2.0:1777580337.472788:0:187631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472801:0:187631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472808:0:187631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472814:0:187631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680fe00 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:2.0:1777580337.472819:0:187631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472826:0:187631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472843:0:187631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02497a21b00) 00010000:00010000:2.0:1777580337.472846:0:187631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777580337.472859:0:187631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777580337.472866:0:187631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680fe00/0xcb2b2f2f7e4e5ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777580337.472888:0:187631:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000430aed41 reply state 000000007ff35707 transno 8589951171 ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777580337.472898:0:187631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777580337.473029:0:187631:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1220a945-26e8-4f93-ba75-88d1936cf5a4+30:283864:x1863919946853376:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 5477us (6172us total) trans 8589951171 rc 0/0 00000100:00100000:2.0:1777580337.473039:0:187631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 882 00010000:00010000:0.0:1777580337.478905:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478928:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478937:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478944:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa024a680f400 already unused, calling callback (ffffffffc1fac4f0) 00010000:00010000:0.0:1777580337.478950:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478958:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478978:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffffa02497a21600) 00010000:00010000:0.0:1777580337.478982:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777580337.478988:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777580337.478994:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa024a680f400/0xcb2b2f2f7e4e5b4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777580337.709259:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917520000:0@lo:400:kworker.0 00000100:00100000:1.0:1777580337.709350:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580337.709444:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777580337.709454:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917520128:0@lo:400:kworker.0 00000100:00100000:1.0:1777580337.709488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580337.709556:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520000 00000100:00100000:1.0:1777580337.709565:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520000 00000100:00100000:2.0:1777580337.710975:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917519872:0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.711052:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580337.711347:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917520384:0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.711380:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777580337.711415:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777580337.711425:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02385fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917519744:0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.711463:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580337.711475:0:207637:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519872 00000100:00100000:1.0:1777580337.711484:0:207637:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519872 00000100:00100000:2.0:1777580337.711509:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917520256:0@lo:400:kworker.0 00000100:00100000:1.0:1777580337.711533:0:207637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1777580337.711540:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580337.711548:0:207637:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917520000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.711592:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520128 00000100:00100000:2.0:1777580337.711610:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520128 00000100:00100000:2.0:1777580337.711653:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520384 00000100:00100000:2.0:1777580337.711656:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520384 00000100:00100000:2.0:1777580337.711676:0:191688:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520256 00000100:00100000:2.0:1777580337.711679:0:191688:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520256 00000100:00100000:2.0:1777580337.711699:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1777580337.711708:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917520128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712572:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917520128:12345-0@lo:400:kworker.0 Request processed in 861us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.712582:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1777580337.712616:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1777580337.712627:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712676:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917520384:12345-0@lo:400:kworker.0 Request processed in 52us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.712683:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1777580337.712695:0:191688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1777580337.712701:0:191688:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917520256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712730:0:191688:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917520256:12345-0@lo:400:kworker.0 Request processed in 30us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.712736:0:191688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1777580337.712764:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1777580337.712772:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917519872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712822:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917519872:12345-0@lo:400:kworker.0 Request processed in 52us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580337.712828:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1777580337.712898:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917520256:0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712919:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917519872:0@lo:400:kworker.0 00000100:00100000:2.0:1777580337.712929:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917520384:0@lo:400:kworker.0 00000100:00100000:1.0:1777580337.716385:0:207637:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917520000:12345-0@lo:400:kworker.0 Request processed in 4829us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580337.716405:0:207637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:1.0:1777580337.716469:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777580337.716478:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777580337.716482:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777580337.716579:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917520128:0@lo:400:kworker.0 00000100:00100000:1.0:1777580337.716595:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917520000:0@lo:400:kworker.0 00000100:00100000:0.0:1777580337.717876:0:187625:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917519744 00000100:00100000:0.0:1777580337.717931:0:187625:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917519744 00000100:00100000:0.0:1777580337.718022:0:187625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1777580337.718035:0:187625:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917519744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580337.726071:0:187625:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917519744:12345-0@lo:400:kworker.0 Request processed in 8025us (14592us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580337.726089:0:187625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1777580337.728261:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02385fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917519744:0@lo:400:kworker.0 00010000:00010000:2.0:1777580337.903863:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777580338.731191:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777580338.731217:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917520512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777580338.731383:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580338.732061:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520512 00000100:00100000:0.0:1777580338.732072:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520512 00000100:00100000:0.0:1777580338.732305:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1777580338.732318:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917520512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777580338.732361:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1777580338.732429:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ad9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917520512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580338.732436:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1777580338.734163:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917520512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777580338.739082:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777580338.739112:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917520640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777580338.739221:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580338.739285:0:188251:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520640 00000100:00100000:1.0:1777580338.739295:0:188251:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520640 00000100:00100000:1.0:1777580338.739359:0:188251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1777580338.739369:0:188251:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917520640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777580338.739416:0:188251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39780352 pending 0 free 3819962368 avail 3817865216 00000100:00100000:1.0:1777580338.739485:0:188251:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917520640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580338.739492:0:188251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1777580338.739552:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917520640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777580338.923067:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580339.947234:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777580340.970901:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777580341.719090:0:210221:0:(nrs_tbf.c:597:nrs_tbf_rule_start()) TBF starts rule@ffffa02484894e00 rate 10000 gen 0 00010000:00010000:2.0:1777580342.006431:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580342.453903:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.453944:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.453975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.453993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.454017:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.454052:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853632 00000100:00100000:1.0:1777580342.454064:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853632 00000100:00100000:1.0:1777580342.454126:0:205909:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854016 00000100:00100000:1.0:1777580342.454129:0:205909:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854016 00000100:00100000:1.0:1777580342.454169:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 522 00000100:00100000:1.0:1777580342.454180:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946853632:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580342.454307:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1220a945-26e8-4f93-ba75-88d1936cf5a4+29:2362:x1863919946853632:12345-192.168.202.9@tcp:400: Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.454315:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 522 00000100:00100000:1.0:1777580342.454336:0:205909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 523 00000100:00100000:1.0:1777580342.454342:0:205909:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2362:x1863919946854016:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580342.454396:0:205909:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2362:x1863919946854016:12345-192.168.202.9@tcp:400: Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.454402:0:205909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 523 00000100:00100000:1.0:1777580342.454421:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853888 00000100:00100000:1.0:1777580342.454424:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853888 00000100:00100000:1.0:1777580342.454466:0:205897:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853760 00000100:00100000:1.0:1777580342.454469:0:205897:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853760 00000100:00100000:1.0:1777580342.454509:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 352 00000100:00100000:1.0:1777580342.454515:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946853888:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580342.454575:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946853888:12345-192.168.202.9@tcp:400: Request processed in 60us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.454581:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 352 00000100:00100000:1.0:1777580342.454592:0:205897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 353 00000100:00100000:1.0:1777580342.454598:0:205897:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946853760:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580342.454635:0:205897:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2362:x1863919946853760:12345-192.168.202.9@tcp:400: Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.454641:0:205897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 353 00000100:00100000:1.0:1777580342.454661:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946853504 00000100:00100000:1.0:1777580342.454664:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946853504 00000100:00100000:1.0:1777580342.454690:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 433 00000100:00100000:1.0:1777580342.454697:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946853504:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580342.454720:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2362:x1863919946853504:12345-192.168.202.9@tcp:400: Request processed in 25us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.454726:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 433 00000100:00080000:1.0:1777580342.454763:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777580342.454767:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777580342.454770:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1777580342.460951:0:5777:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589951171 is committed 00000100:00100000:0.0:1777580342.481790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1777580342.481977:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580342.495940:0:193009:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854144 00000100:00100000:1.0:1777580342.495961:0:193009:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854144 00000100:00100000:3.0:1777580342.497578:0:206023:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854272 00000100:00100000:3.0:1777580342.497592:0:206023:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854272 00000100:00100000:3.0:1777580342.497748:0:193009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12298 00000100:00100000:3.0:1777580342.497760:0:193009:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2360:x1863919946854144:12345-192.168.202.9@tcp:9: 00000020:00000080:3.0:1777580342.497800:0:193009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcb2b2f2f7dc8e1a 00000100:00080000:1.0:1777580342.497994:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777580342.498016:0:193009:0:(import.c:65:import_set_state_nolock()) ffffa02483210800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777580342.498099:0:188248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12299 00000100:00100000:0.0:1777580342.498107:0:188248:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+5:2360:x1863919946854272:12345-192.168.202.9@tcp:9: 00000020:00000080:0.0:1777580342.498122:0:188248:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcb2b2f2f7dc8dc6 00000100:00080000:0.0:1777580342.498127:0:188248:0:(import.c:65:import_set_state_nolock()) ffffa02392936800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777580342.498193:0:188248:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589938738 00000100:00100000:0.0:1777580342.498563:0:188248:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+2:2360:x1863919946854272:12345-192.168.202.9@tcp:9: Request processed in 449us (16578us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580342.498572:0:188248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12299 00010000:00010000:0.0:1777580342.498615:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580342.498822:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777580342.507398:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1777580342.513971:0:193009:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589939137 00000100:00100000:0.0:1777580342.514366:0:193009:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e34df675-1aa3-4a1f-9c3e-2f402307d398+2:2360:x1863919946854144:12345-192.168.202.9@tcp:9: Request processed in 16602us (32583us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580342.514380:0:193009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12298 00000100:00100000:0.0:1777580342.827298:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917520896:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827387:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827461:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917521408:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827499:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827528:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1777580342.827534:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917520768:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827577:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827600:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917521280:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827623:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827663:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917521152:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827688:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827704:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777580342.827709:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917521024:0@lo:400:kworker.0 00000100:00100000:0.0:1777580342.827727:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580342.827755:0:205898:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520896 00000100:00100000:0.0:1777580342.827763:0:205898:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520896 00000100:00100000:1.0:1777580342.828743:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521408 00000100:00100000:1.0:1777580342.828753:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521408 00000100:00100000:1.0:1777580342.828843:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521280 00000100:00100000:1.0:1777580342.828847:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521280 00000100:00100000:1.0:1777580342.828867:0:187630:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521152 00000100:00100000:1.0:1777580342.828870:0:187630:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521152 00000100:00100000:1.0:1777580342.828896:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1777580342.828906:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917521408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.828998:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917521408:12345-0@lo:400:kworker.0 Request processed in 94us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.829006:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1777580342.829027:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1777580342.829033:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917521280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829062:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917521280:12345-0@lo:400:kworker.0 Request processed in 29us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.829068:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1777580342.829079:0:187630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1777580342.829085:0:187630:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024ac337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917521152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829117:0:187630:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024ac337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1863919917521152:12345-0@lo:400:kworker.0 Request processed in 33us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.829122:0:187630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1777580342.829186:0:187625:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917520768 00000100:00100000:1.0:1777580342.829190:0:187625:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917520768 00000100:00100000:1.0:1777580342.829217:0:187625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1777580342.829223:0:187625:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917520768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829252:0:187625:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917520768:12345-0@lo:400:kworker.0 Request processed in 30us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.829258:0:187625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00080000:1.0:1777580342.829317:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777580342.829332:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777580342.829345:0:206020:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521024 00000100:00100000:1.0:1777580342.829349:0:206020:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521024 00000100:00100000:1.0:1777580342.829381:0:206020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1777580342.829388:0:206020:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02397d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917521024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829420:0:206020:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02397d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917521024:12345-0@lo:400:kworker.0 Request processed in 32us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.829426:0:206020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:1.0:1777580342.829447:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777580342.829510:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917520768:0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829527:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917521280:0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829540:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917521408:0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829606:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917521024:0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.829617:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1863919917521152:0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.837065:0:205898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1777580342.837101:0:205898:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917520896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777580342.837298:0:205898:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917520896:12345-0@lo:400:kworker.0 Request processed in 217us (9910us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580342.837307:0:205898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1777580342.840918:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa02384fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917520896:0@lo:400:kworker.0 00010000:00010000:0.0:1777580343.019256:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580343.851338:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777580343.851355:0:3289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917521536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777580343.851438:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580343.851534:0:192556:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521536 00000100:00100000:1.0:1777580343.851550:0:192556:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521536 00000100:00100000:1.0:1777580343.851606:0:192556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1777580343.851644:0:192556:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917521536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777580343.851687:0:192556:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 36372480 pending 0 free 3819962368 avail 3817865216 00000100:00100000:1.0:1777580343.851736:0:192556:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1863919917521536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580343.851743:0:192556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1777580343.851875:0:3289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024b7dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1863919917521536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777580343.857118:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777580343.857181:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777580343.857268:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777580343.857340:0:188249:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521664 00000100:00100000:1.0:1777580343.857348:0:188249:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521664 00000100:00100000:1.0:1777580343.857396:0:188249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1777580343.857417:0:188249:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917521664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777580343.857458:0:188249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 36372480 pending 0 free 3845128192 avail 3843031040 00000100:00100000:1.0:1777580343.857501:0:188249:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa024b7dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917521664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580343.857507:0:188249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1777580343.857953:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa024ad9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917521664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777580344.048216:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777580345.071959:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777580345.272459:0:210272:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy 00010000:00010000:0.0:1777580346.092889:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1777580346.523472:0:7429:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e34df675-1aa3-4a1f-9c3e-2f402307d398 00000020:00000080:3.0:1777580346.523482:0:7429:0:(genops.c:906:class_export_put()) final put ffffa024879ae000/e34df675-1aa3-4a1f-9c3e-2f402307d398 00000020:00000080:1.0:1777580346.523737:0:175586:0:(genops.c:865:class_export_destroy()) destroying export ffffa024879ae000/e34df675-1aa3-4a1f-9c3e-2f402307d398 for lustre-OST0001 00000020:00000080:1.0:1777580346.523851:0:175586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa02392936800 for lustre-OST0001 00000001:00100000:0.0:1777580346.534091:0:6562:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e34df675-1aa3-4a1f-9c3e-2f402307d398 00000020:00000080:0.0:1777580346.534110:0:6562:0:(genops.c:906:class_export_put()) final put ffffa02483216000/e34df675-1aa3-4a1f-9c3e-2f402307d398 00000020:00000080:0.0:1777580346.534181:0:189799:0:(genops.c:865:class_export_destroy()) destroying export ffffa02483216000/e34df675-1aa3-4a1f-9c3e-2f402307d398 for lustre-OST0000 00000020:00000080:0.0:1777580346.534273:0:189799:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa02483210800 for lustre-OST0000 00010000:00010000:0.0:1777580347.114317:0:187619:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777580347.552567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580347.552620:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580347.552650:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1777580347.552682:0:187624:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854400 00000100:00100000:1.0:1777580347.552694:0:187624:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854400 00000100:00100000:1.0:1777580347.552782:0:187624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 435 00000100:00100000:1.0:1777580347.552793:0:187624:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2363:x1863919946854400:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580347.552878:0:187624:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d132bb4b-7b31-4517-8548-d49c4a9d266d+12:2363:x1863919946854400:12345-192.168.202.9@tcp:400: Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580347.552886:0:187624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 435 00000100:00100000:1.0:1777580347.552928:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854528 00000100:00100000:1.0:1777580347.552932:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854528 00000100:00100000:1.0:1777580347.552967:0:187632:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854912 00000100:00100000:1.0:1777580347.552985:0:187632:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854912 00000100:00100000:1.0:1777580347.553012:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 527 00000100:00100000:1.0:1777580347.553019:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946854528:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580347.553083:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1220a945-26e8-4f93-ba75-88d1936cf5a4+28:2363:x1863919946854528:12345-192.168.202.9@tcp:400: Request processed in 65us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580347.553089:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 527 00000100:00100000:1.0:1777580347.553377:0:187632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 528 00000100:00100000:1.0:1777580347.553387:0:187632:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2363:x1863919946854912:12345-192.168.202.9@tcp:400: 00000100:00100000:1.0:1777580347.553438:0:187632:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02384ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e34df675-1aa3-4a1f-9c3e-2f402307d398+307:2363:x1863919946854912:12345-192.168.202.9@tcp:400: Request processed in 54us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1777580347.553444:0:187632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 528 00000100:00080000:1.0:1777580347.553681:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777580347.558796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580347.558839:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1777580347.558868:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854656 00000100:00100000:3.0:1777580347.558878:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854656 00000100:00100000:3.0:1777580347.558926:0:205900:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919946854784 00000100:00100000:3.0:1777580347.558928:0:205900:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919946854784 00000100:00100000:3.0:1777580347.558946:0:205900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12300 00000100:00100000:3.0:1777580347.558957:0:205900:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2360:x1863919946854656:12345-192.168.202.9@tcp:9: 00000020:00000080:3.0:1777580347.558990:0:205900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcb2b2f2f7dc840a 00000100:00080000:3.0:1777580347.558998:0:205900:0:(import.c:65:import_set_state_nolock()) ffffa024851d3000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1777580347.563382:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777580347.563394:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580347.580088:0:189456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12301 00000100:00100000:0.0:1777580347.580128:0:189456:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+5:2360:x1863919946854784:12345-192.168.202.9@tcp:9: 00000020:00000080:0.0:1777580347.580216:0:189456:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcb2b2f2f7dc8449 00000100:00080000:0.0:1777580347.580229:0:189456:0:(import.c:65:import_set_state_nolock()) ffffa024851d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777580347.590656:0:205900:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589939137 00000100:00100000:2.0:1777580347.591060:0:205900:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1220a945-26e8-4f93-ba75-88d1936cf5a4+2:2360:x1863919946854656:12345-192.168.202.9@tcp:9: Request processed in 32098us (32265us total) trans 0 rc 0/0 00000100:00100000:2.0:1777580347.591075:0:205900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12300 00000001:00000004:0.0:1777580347.594721:0:189456:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589938738 00010000:00010000:2.0:1777580347.595207:0:187618:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580347.595295:0:189456:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023871e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1220a945-26e8-4f93-ba75-88d1936cf5a4+2:2360:x1863919946854784:12345-192.168.202.9@tcp:9: Request processed in 15188us (36447us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.595310:0:189456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12301 00010000:00010000:3.0:1777580347.600265:0:208519:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777580347.946393:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917521920:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946469:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946565:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917522432:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946600:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946628:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1777580347.946633:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917521792:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946684:0:3291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917522304:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946705:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946728:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917522048:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946750:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946767:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777580347.946772:0:3288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917522176:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946790:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777580347.946834:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521920 00000100:00100000:0.0:1777580347.946842:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521920 00000100:00100000:0.0:1777580347.946891:0:205906:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917522048 00000100:00100000:0.0:1777580347.946894:0:205906:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917522048 00000100:00100000:0.0:1777580347.946915:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1777580347.946925:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.946973:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3291:x1863919917521920:12345-0@lo:400:kworker.0 Request processed in 51us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.946981:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1777580347.946998:0:205906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1777580347.947004:0:205906:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947033:0:205906:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3288:x1863919917522048:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.947039:0:205906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1777580347.947057:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917522432 00000100:00100000:0.0:1777580347.947060:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917522432 00000100:00100000:0.0:1777580347.947084:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917522304 00000100:00100000:0.0:1777580347.947087:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917522304 00000100:00100000:0.0:1777580347.947102:0:205914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917522176 00000100:00100000:0.0:1777580347.947104:0:205914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917522176 00000100:00100000:0.0:1777580347.947121:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1777580347.947127:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917522432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947178:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+6:3291:x1863919917522432:12345-0@lo:400:kworker.0 Request processed in 51us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.947184:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1777580347.947195:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1777580347.947200:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917522304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947225:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1863919917522304:12345-0@lo:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.947239:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1777580347.947251:0:205914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1777580347.947256:0:205914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917522176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947281:0:205914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa023a095e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1863919917522176:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.947286:0:205914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1777580347.947305:0:187623:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863919917521792 00000100:00100000:0.0:1777580347.947308:0:187623:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863919917521792 00000100:00100000:0.0:1777580347.947334:0:187623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1777580347.947339:0:187623:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa02490524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917521792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947364:0:187623:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa02490524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cfe4ba-1c77-4cea-977e-78bab78865b1+18:3291:x1863919917521792:12345-0@lo:400:kworker.0 Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1777580347.947369:0:187623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:0.0:1777580347.947404:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777580347.947408:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777580347.947410:0:187626:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777580347.947458:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1863919917522176:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947468:0:3288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1863919917522048:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947495:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9cfe4ba-1c77-4cea-977e-78bab78865b1:3291:1863919917521792:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947504:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1863919917522304:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947528:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023e64daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1863919917521920:0@lo:400:kworker.0 00000100:00100000:0.0:1777580347.947536:0:3291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa023a095ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1863919917522432:0@lo:400:kworker.0 00010000:00010000:2.0:1777580348.142298:0:188704:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 54680 lines, 54680 kept, 0 dropped, 0 bad.